r 


ij   1 


./?  f"^'  f 


|W  YO«K  IMVERSn  Y 

mtvlT  INSfSrUTE  -  LiBRAP' 


AEC  Computing  and 
Applied  Mathematics  Center 


AEC  RESEARCH  AND  DEVELOPMENT  REPORT 


TID-4500  NYO-1480-19 

31st  Ed.     Mathematics  and  Computers 


PATTERN  RECOGNITION 

by 

R.  Blanchinl  and  M.  Shostak 
December  I5 .  1964 


Courant   Institute  of  Mathematical  Sciences 


NEW  YORK   UNIVERSITY 

NEW    YORK,    NEW    YORK 


r/ 


251  Mercer  Si.    i^e 


This  report  was  prepared  as  an  account  of  Government  sponsored  work.  Neither 
the  United  States,  nor  the  Commission,  nor  any  person  acting  on  behalf  of  the 
Commission: 

A.  Makes  any  warranty  or  representation,  express  or  implied,  with  respect  to 
the  accuracy,  completeness,  or  usefulness  of  the  information  contained  in 
this  report,  or  that  the  use  of  any  information,  apparatus,  method,  or 
process  disclosed  in  this  report  may  not  infringe  privately  owned  rights;  or 

3.  Assumes  any  liabilities  with  respect  to  the  use  of,  or  for  damages  resulting 
from  the  use  of  any  information,  apparatus,  method,  or  process  disclosed 
in  this  report. 

Arused  in  the  above,  "person  acting  on  behalf  of  the  Commission"  includes 
any  employee  or  contractor  of  the  Commission,  or  employee  of  such  contractor, 
to  the  extent  that  such  employee  or  contractor  of  the  Commission,  or  employee 
of  such  contractor  prepares,  disseminates,  or  provides  access  to,  any  information 
pursuant  to  his  employment  or  contract  with  the  Commission,  or  his  employment 
with  such  contractor. 


i 


UNCLASSIFIED 


AEC  Computing  and  Applied  Mathematics  Center 
Courant  Institute  of  Mathematical  Sciences 
New  York  University 


TID-4500  NYO-1480-19 

31st  Ed.     Mathematics  and  Computers 


PATTERN  RECOGNITION 
R.  Bianchini  and  M.  Shostak 


Decemher  I5 ,  I964 


Contract  No.  AT( 3O-I )-l480 


NEW  YOi^iN  U.  ilvLix^i.  1 
-    1    -  COURANT  INSTirU  i  E  -  L^i<- .RY 

1251  Mercer  St.    New  York,  N.Y.  10012 

UNCLASSIFIED 


/ 


c.  < 


K 


NYO-1480-19 
MATHEMATICS  AND 
COMPUTERS 


ABSTRACT 


Report  is  made  of  a  character  recognition  study  and 
development  of  a  digital  computer  Input  device  for  reading 
and  translating  handprinted  FORTRAN  programs.   Based  upon 
a  2000-specimen  library,  computer  recognition  programs  were 
written  to  partition  the  hO   alphanumeric  character  classes 
used  as  input  into  a  total  of  20  classes  with  an  accuracy 
of  slightly  over  90%.   Further  refinement  of  methods  used 
in  this  study  would  probably  lead  to  full  40-class  partition, 
with  an  accuracy  of  about  90  /o  . 
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PATTERN  RECOGNITION 


1.   INTRODUCTION 

Significant  strides  have  been  made  in  the  last  ten  years 
in  data  processing  techniques  and  equipment.   This  decade  has  seen 
the  advent  of  very  large  and  truly  random  access  memories,  an 
Increase  of  several  orders  of  magnitude  in  computation  speed, 
development  of  versatile  compilers  and  other  software,  and  a 
continuous  increase  in  overall  rellahlllty . 

Despite  spectacular  Increases  in  central  processor  speed, 
scope,  and  rellahlllty,  improvements  in  peripheral  equipment 
have  lagged.   In  particular,  the  Input  problem  has  been  and 
remains  a  bottleneck.   By  "input  problem"  we  mean  that  stage  of 
a  data  processing  task  which  involves  conversion  of  data  from 
their  natural  state  into  a  form  suitable  for  machine  assimilation. 
At  best,  the  machine  form  is  obtained  in  a  time  quite  dispro- 
portionate to  that  required  for  computed  results;   at  worst,  the 
natural  data  are  completely  incompatible  with  computer-aided 
techniques. 


Anyone  who  has  waited  a  day  or  more  for  keypunching  will 
appreciate  this  point. 

2 

A  prime  example  of  this  is  mail  sorting. 
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Research  described  In  this  report  was  undertaken  in  an 
attempt  to  solve  a  special  case  of  the  input  problem,  of  great 
concern  to  people  otherwise  requiring  only  moderate  amounts  of 
machine  time  for  "scientific"  problems.   Typically,  this  class 
of  users  requires  less  than  15  minutes  of  machine  time  (7O9O 
or  its  equivalent)  for  a  given  problem,  and  computations  are 
performed  only  once  or  at  most  a  few  times.   Thus,  for  small, 
nonrepetltive  programs,  effort  and  time  involved  to  convert  the 
initial  handcoded  program  into  machine-assimilable  form  becomes 
an  appreciable  portion  of  the  total  time"  and  effort  expended. 
It  is  not  at  all  unusual  that  an  hour  or  more  of  keypunching  is 
required  for  a  program  that  will  run  for  two  minutes,  or  that 
a  program  is  delayed  a  half  day  to  several  days  by  the  keypuncher's 
schedule . 

Initial  stages  of  the  program  centered  on  general 
properties  and  requirements  of  adaptive  systems.   The  following 
questions  were  considered,  which  were  continuously  refined  and 
reformulated  throughout  the  study: 

(a)  For  a  given  class  of  patterns,  what  kind  of  trans- 
formation should  be  made  from  input  representation  to  machine 
representation? 

(b)  For  a  given  class  of  transformation  elements  or 
organs,  what  kind  of  connection  topology  should  be  used? 

(c)  Assuming  a  randomly-generated  machine  at  the 
beginning,  how  can  the  process  of  adaption  be  implemented  in  a 
simple  manner? 
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Or  ( composltely  stated): 

How  can  a  computer  program  be  devised  whose  end-product 
would  be  the  optimum  device  attained  by  the  adaptive  process 
of  an  initial  randomly-generated  machine? 

Early  experiments  were  in  area  comparison  of  unknown 
inputs  with  standards  (masks)  (reported  in  Section  2).   Binary 
representation  of  a  400-speclmen  library  of  photographically- 
enlarged  handprinted  characters  and  an  account  of  farther  area 
comparison  experiments  are  set  forth  in  Section  3.   With  the 
construction  of  a  flying-spot  scanner  (described  in  Section  4) 
permitting  direct  conversion  of  specimen  to  binary  form,  the 
library  was  enlarged  to  2000  specimens  and  improvements  made 
in  form  and  storage  of  binary  information  (Section  5). 

The  device  proposed  in  Section  6  in  its  simplest  form 
consists  of  a  page  reader  together  with  associated  logic: 
The  programmer  inserts  rough,  handcoded  sheets  into  the  reader 
one  by  one,  receiving  a  deck  of  punched  cards  as  output.   Such 
a  perfected  device  should  make  a  significant  contribution  to 
simplify  and  speed  up  the  overall  computational  process,  as  well 
as  attracting  a  wider  class  of  users  to  computer  facilities. 

Design  of  the  page  reader  Involved  many  practical  and 
theoretical  difficulties.   To  keep  the  scope  of  the  program 
within  manageable  bounds  it  was  decided  to  concentrate  efforts 
on  the  recognition  problem:   Development  of  a  method  for  the 
recognition  of  handprinted  alphanumeric  characters.   Practical 
considerations  of  hardware  realizablllty ,  although  not  of 
immediate  Interest,  were  nevertheless  always  used  as  guides  in 
evaluating  and  modifying  various  techniques  as  they  evolved. 
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Since  FORTRAN  at  the  present  time  is  the  most  widely- 
used  computer  language  and  there  are  indications  that  it  will 
so  remain  despite  introductions  of  competitors  like  ALGOL, 
our  general  approach  has  been  closely  guided  by  traits  of 
FORTRAN-coded  programs.   We  have  considered  that   (a)  a  large 
variety  of  symbols  should  be  available  for  flexible  and  facile 
coding;   (b)  direct  machine  use  of  handcoded  programs  should 
be  possible. 

Thus,  the  main  objectives  of  the  study  were  threefold: 

(a)  To  study  and  develop  general  methods  of  pattern 
recognition. 

(b)  To  apply  this  knowledge  to  development  of  an 
input  device  capable  of  reading  and  translating  hand- 
printed FORTRAN  programs. 

(c)  To  study  modifications  of  contemporary  digital 
computer  organization  to  expedite  certain  non-numeral 
forms  of  data  processing  required  in  pattern  recognition. 

These  aspects  of  pattern  recognition  are  not  independent; 
however,  throughout  the  study  principal  emphasis  was  on 
development  of  an  input  device. 

2.   PRELIMINARY  INVESTIGATIONS  WITH  SMALL  MOSAICS 

2.1   Approach 

The  first  recognition  methods  were  essentially  area- 
matching  schemes.   Each  pattern  class  or  alphanumeric  character 
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was  to  be  represented  by  one  templet  or  "mask"  that  in  some 
sense  would  "be  representative  of  its  class.   Hence,  given  a 
set  of  masks,  an  unknown  Input  could  be  compared  with  each 
mask  and  the  resulting  comparisons  (set  of  numbers)  examined 
to  determine  to  which  pattern  class  the  input  should  be  assigned. 

There  were  two  interrelated  problems  associated  with 
such  an  approach:   (1)  Determining  what  kind  of  comparison  to 
perform.   (2)  Finding  a  way  to  generate  the  set  of  masks. 

2.1.1.  Input-Mask  Comparisons.   The  most  significant 
comparison  obviously  was  in  the  area  common  to  both  input  and 
mask.   An  unknown  Input  then  could  be  assigned  to  that  pattern 
class  represented  by  the  mask  yielding  the  largest  common  area. 
Although  simple  and  easy  to  mechanize  as  the  logical  "AND" 
function,  the  common-area  comparison  had  several  serious 
disadvantages.   First  of  all,  there  was  a  bias  towards  the  larger 
symbols:   For  a  given  amount  of  displacement,  an  input  "T"  could 
have  more  in  common  for  the  mask  for  "0"  than  with  the  mask  for 
"T".   Second,  no  weighting  was  given  to  areas  where  the  symbol 
should  not  be.   An  unknown  could  have  more  area  in  common  with 

an  Incorrect  mask  than  with  the  correct  one  and  be  incorrectly 
identified. 

Examination  of  mask  areas  where  the  presence  of  a  symbol 
was  not  expected  seemed  useful  as  an  additional  condition  to 
be  satisfied.   Thus,  the  "exclusive-OR"  logical  function  that 
takes  into  account  both  desired  and  undesired  areas  was  used 
as  a  basis  of  comparison  between  input  and  mask. 

2.1.2.  Mask  Generation.   A  set  of  90  letter  specimens 
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consisting  of  nine  samples  of  each  of  the  patterns  F,  E,  G, 
C,  0,  D,   B,  5,  P,  R  was  prepared,  using  a  grid  of  nine  rows 
and  eight  columns.   The  grid  dimensions  were  chosen  to  set  the 
"area"  of  the  grid  at  72  hits,  a  convenient  multiple  of  the 
IBM  704  word-length.   In  forming  the  specimens,  no  attempt  was 
made  for  "realism".   The  first  sample  of  each  specimen  was 
formed  "by  drawing  a  centered  letter  of  proportions  pleasing  to 
the  eye;  the  additional  eight  samples  were  obtained  from  the 
first  by  simple  vertical  and  horizontal  shifts.   No  distortions 
or  additive  noise  were  Introduced,  since  it  was  felt  that  the 
merits  of  the  exclusive-OR  should  he  first  determined. 

2.1.3.   Recognition  Operation.   For  a  mask  of  a  particular 
class  M  and  an  unknown  input  specimen  S,   the  operation 
performed  is  expressed  hy: 

a  =  72  -  KA(S  *  M), 

where  the  asterisk  denotes  the  exclusive-OR  function  and  KA 
is  an  operator  meaning  "count  the  total  number  of  unit  bits". 
If  S   and  M   coincide  perfectly,   KA(S  *  M)  -  0   since 
S*M=^M+SM  =0+0=0   and   a  =  72,   the  highest  possible 
score.   If  a  specimen  S   Identical  to  M   is  displaced  slightly 
so  that  the  area  of  coincidence  diminishes  by  A,   the  net  score 
a  will  diminish  not  by  A  but  by  2A  because  the  exclusive-OR 
function  in  effect  assigns  a  negative  weight  to  portions  of  the 
mask  where  an  image  is  not  expected.   (If  the  exclusive-OR  were 
replaced  by  the  logical  AND,  the  decrement  would  be   A;  thus, 
the  exclusive-OR  accentuates  the  effect  of  a  given  lack  of 
coincidence . ) 
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2.2.   Problem  1 

The  recognition  process  was  simulated  by  a  SAP-coded 
program  for  the  IBM  70^.   Each  specimen  occupied  two  machine 
words.   Presence  of  a  letter  in  a  given  bit  position  was 
signified  by  making  that  bit  "1";  absence  of  the  letter  was 
denoted  by  making  the  bit  "0".   A  similar  convention  was  used 
for  the  masks. 

Masks  were  generated  by  taking  the  logical-OR  of  a 
number  of  specimens.   This  number  was  varied  from  1  to  9j  the 
maximum  number  of  samples  of  a  given  pattern  available.   No 
attempt  was  made  to  permute  the  specimens  in  choosing  a  set; 
if  five  specimens  were  used,  they  were  taken  as  the  first 
five. 

Fig.  2.1  shows  results  of  tests  using  masks  built  up 
from  1,3)5>7>9  specimens,  respectively.   An  unknown  specimen 


Number   of 
Specimens 
Used  to 
Generate  Masks 

Number   of   Correct 

Recognitions 

FEGC0DB3PR 

Total 
Correct 

/o    Correct 

1 

5214212411 

23 

26% 

3 

7200400500 

18 

20% 

5 

6000600410 

17 

19% 

7 

9000500310 

18 

20% 

9 

9000600210 

18 

20% 

Fig.  2.1.   Problem  1.   Scores  Obtained  with  Exclusive-OR 
Comparison.   72-bit  Mosaic. 
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was  presented  to  each  of  the  ten  masks,  resulting  in  ten  numbers. 
The  membership  class  was  defined  as  that  one  corresponding  to  the 
mask  generating  the  largest  number.   A  tie  between  the  correct 
class  and  some  other  class  was  defined  as  an  error.   (It  was  not 
considered  worthwhile  at  this  point  to  Incorporate  a  rejection 
capability;  I.e.,  a  character  was  always  accepted  for  Identifica- 
tion, the  result  being  either  correct  or  not.)   It  will  be  noted 
that  the  highest  score  Is  26 /o ,  a  poor  result  due  to  strong 
discrimination  properties  of  the  excluslve-OR;  once  a  letter  has 
been  shifted  It  becomes  a  "different"  letter  to  the  mask. 
Clearly,  a  centering  process  would  Improve  the  scores  but  reduce 
the  problem  to  triviality,  since  the  sample  sets  were  Initially 
formed  by  shifts. 

The  operation  used  In  this  problem  Is  equivalent  to 
finding  the  Euclidian  distance  between  a  pair  of  72-dlmensional 
vectors.   The  distance  Is  always  subtracted  from  72  in  order 
that  the  maximum  value  be  the  correct  one.   Results  show  that 
small  displacements  of  a  letter  tend  to  make  it  lose  all  or 
most  of  its  resemblance  to  the  undisplaced  letter.   This  implies 
that  good  performance  should  be  obtained  from  a  system  having: 

(a)   As  many  masks  per  class  as  there  are  specimens  in 
that  class; 


or 


(b)   All  specimens  in  a  class  identical  in  size,  shape, 
and  position,  as  would  result  from  printed  material 
with  centering  mechanism. 


13  - 


2.3-   Problem  2 

In  Problem  2,  90  masks  were  used  with  90  specimens; 
the  problem  was  identical  to  Problem  1  in  other  respects.   All 
of  the  specimens  were  correctly  recognized;  although  some  of 
the  discrimination  margins  were  rather  slim  (3  parts  out  of  72), 
there  were  no  ties.   However,  it  does  not  seem  feasible  to  store 
a  replica  of  each  specimen,  even  in  the  improbable  event  that 
all  specimens  that  might  ever  be  encountered  were  available. 

2.4.   Problem  4^ 

If  specimens  are  considered  as  binary  vectors  in  a 
72-dimensional  space,  the  poor  performance  obtained  in  Problem  1 
can  be  considered  as  due  to  an  undesirable  clustering  of  points 
(specimens)  from  different  pattern  classes.   Ideally,  each  mask 
would  represent  the  "center"  of  a  group  of  points  corresponding 
to  the  specimens  belonging  to  that  class;  each  specimen  in  a 
class  should  be  closer  (in  the  Euclidian  sense)   to  its  mask 
than  to  any  other  mask.   Clearly  this  was  not  the  case  in 
Problem  1. 

Problem  4  tested  the  hypothesis  that  performance  would 
be  improved  by  increasing  the  size  of  the  vector  space;  this 
would  allow  points  representing  the  masks  to  separate  a  little, 
possibly  reducing  undesired  clustering.   The  size  of  the  mosaic 
was  increased  from  72  to  14^  bits  (13  x  11)  and  a  new  set  of 
90  specimens  was  prepared,  exactly  as  in  Problem  2.   A  set  of 
subroutines  for  logical  operations  on  blocks  of  IBM  704  words 


Problem  3  was  cancelled. 
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was  written;  these  Included  input-output  routines  and  were 
general  in  the  sense  that  changes  in  the  mosaic  size  did  not 
necessitate  change  of  the  subroutines.   Two  samples  of  a  symbol 
as  printed  by  the  output  routine  "PRINT"  appear  in  Fig.  2.2. 
Fig.  2.3  shows  results  obtained  from  a  test  using  exclusive-OR 
for  comparison  and  ten  masks,  each  mask  simply  the  first 
specimen  in  each  class.   As  anticipated,  the  performance  improved 
from  26/0  of  Problem  1  to  4l/o  (still  far  from  satisfactory). 
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Fig.  2.2.   Two  Samples  of  13  x  11  Symbols  as  Printed  by 
the  Output  Subroutine  PRINT. 


Pattern 

Total 
Correct 

% 

Correct 

FEG0CDB5PR 
8313443623 

37 

41 

Fig.  2.3.   Problem  4.   143-Bit  Mosaic,  10  Masks, 

Exclusive-OR. 
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2.5 .   Pro"blems  5,  6,  and  7 

In  these  problems  an  attempt  was  made  to  break  up  the 
excluslve-OR  into  its  two  components,  one  corresponding  to  the 
area  where  a  letter  is  expected,  the  other  to  an  area  where  the 
letter  is  not  expected.   It  was  hoped  that  one  of  the  two 
components  would  prove  to  be  a  strong  discrimination  function. 
To  this  end.  Thresholds  1,  2,  3,  4  were  defined  as  follows: 


_  Sum  of  zero  bits  in  specimen  overlapping  unit  bits  in  mask 

_  KA(MS) 
KA(M)   ' 

_  _  _  Sum  of  unit  bits  in  specimen  overlapping  zero  bits  in  mask 

Sum  of  zero  bits  in  mask 

^  KA(MS) 
KA(M) 


THRES  3  = 


Sum  of  zero  bits  in  mask  overlapping  unit  bits  of  mask 
Sum  of  unit  bits  in  specimen 

_  KA(SM) 
~  KA(S)   ' 

^   _   Sum  of  unit  bits  In  mask  overlapping  zero  bits  of  mask 
~  Sum  of  zero  bits  in  specimen 

^  KA(MS) 
KA(S) 

Threshold  1  represents  the  deviation  of  specimen  S  from  the  unit 
bits  of  the  mask,  while  Threshold  2  represents  the  deviation  of 
the  specimen  from  the  zero  bits  of  the  mask.   For  perfect  coinci- 
dence, both  thresholds  are  zero.   Thresholds  3  and  4  are  similar. 
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except  that  they  are  referred  to  the  specimen  rather  than  to  the 
mask.   They  too  are  zero  for  perfect  coincidence.   Fig.  2.4 
summarizes  the  results  obtained  in  Problems  5,  6,  and  J. 


Thres- 
hold 
Number 

Number   of 

Specimens 

Used   to  Generate 

Masks 

Correct   Identifications 
FEG^CDB3PR 

Total 
Correct 

/o    Correct 

1 

1 
3 

7212331622 
0333048603 

29 
30 

32 
33 

2 

1 
3 
3 
5 
9 

4323343624 
3227555726 
3853063654 
1436366606 
0447029506 

3^ 

44 

^3 

41 

37 

38 
49 
48 
46 
41 

3 

1 
3 
5 
9 

0213033603 
0227019305 
0336038505 
0447029506 

21 
29 
33 
37 

23 
32 

37 

41 

4 

1 
3 
5 

9010321521 
9000300100 
9000600100 

24 

13 
16 

26 
14 
18 

Fig.  2.4.   Results  of  Problems  5,  6,    7- 

The  masks  were  simply  generated  by  taking  the  OR  of  the 
indicated  number  of  specimens.   For  Threshold  2,  it  will  be  noted 
that  there  are  two  entries  for  masks  generated  from  three  specimens; 
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in  the  first  case  the  first  three  specimens  were  used,  while  in 
the  second  case  the  first,  fourth,  and  seventh  specimens  were 
used.   It  is  clear  that  performance  depends  strongly  on  the 
method  used  to  generate  the  masks.   Of  the  four  thresholds,  the 
best  performance  was  obtained  with  Threshold  2.   Threshold  3 
was  fairly  effective,  while  Thresholds  1  and  4  were  relatively 
ineffective . 

The  best  score  obtained  was  about  50  /o  ,  which,  while 
better  than  the  results  of  using  the  exclusive-OR,  was  still  not 
acceptable. 

2.6.   Concluding  Comment 

Although  performance  obtained  from  this  preliminary 
series  of  experiments  was  far  from  the  minimum  acceptable  level, 
there  seemed  little  point  to  go  further  with  the  limited  sample 
of  "unrealistic"  patterns.   Accordingly,  the  next  step  was  to 
obtain  a  set  of  realistic  patterns  that  would  more  closely 
approximate  inputs  found  in  actual  practice.   The  following 
section  of  this  report  describes  some  of  the  considerations 
involved  in  construction  of  such  a  set  of  patterns. 


5.   400-SPECIMEN  LIBRARY  AND  FURTHER  EXPERIMENTS 

3.1.   Library  of  Specimens 

A  set  of  alphanumeric  specimens  is  indispensable  to  any 
character  recognition  study  since  it  provides  an  objective  means 
of  validating  hypotheses  and  testing  various  recognition  methods. 
Furthermore,  if  specimens  are  representative  of  those  found  under 
field  conditions,  valuable  insights  are  to  be  gained  into  problems 
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which  would  not  even  arise  from  purely  theoretical  considerations, 
For  example,  certain  topologically-oriented  schemes  permit  a 
reasonahle  amount  of  tilt,  shape  and  position  distortion,  yet 
assume  all  inputs  to  be  well-formed  in  the  sense  of  possessing 
perfect  closure.   Even  casual  inspection  of  actual  specimens 
shows  this  to  be  unrealistic;  methods  which  do  not  compensate 
for  this  type  of  distortion  will  never  have  practical  utility. 

The  specimen  library  was  started  with  ten  samples  each 
of  40  different  symbols,  a  total  of  400  specimens.   (Each  sample 
in  a  given  class  was  made  by  a  different  person,  ten  people  in 
all.)   Symbols  consisted  of  the  26  letters,  ten  numerals,  and 
four  special  symbols,  period,  comma,  left  and  right  parentheses. 

3-1.1-   Specimen  Construction.   A  special  coding  form 
was  used,  similar  to  the  standard  FORTRAN  coding  sheet,  on  which 
donors  were  instructed  to  print  one  character  per  guide  box. 
The  guide  boxes  were  arranged  in  rows  modified  by  the  addition 
of  height-limiting  horizontal  lines.   See  Fig.  3.1.   Thus,  each 
symbol  was  to  be  formed  inside  an  area  0.l4"  wide  by  0.l8"  high. 
Moreover,  guide  boxes  for  the  symbols  were  completely  enclosed 
to  limit  the  maximum  size  of  a  specimen.   (While  theoretically 
there  was  no  minimum  limit,  most  people  tend  to  "fill  the  box", 
the  resulting  height  falling  somewhere  between  90%  and  100% 
of  maximum.   In  addition,  the  relatively  small  size  of  the  guide 
boxes  causes  horizontal  lines  such  as  the  crossbars  of  "E"  to 
be  actually  horizontal  within  very  close  limits.   This  is  true 
even  when  vertical  portions  have  an  appreciable  slant  of  as 
much  as  20  degrees.) 

Donors  were  also  instructed  to  place  slashes  through 
the  letters  Z  and  0  and  short  horizontal  bars  on  I  (standard 
FORTRAN  font),  but  otherwise,  no  directions  were  given  concerning 
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Fig.  3.I.   Guide  Box  for  Handprinted  Symbols, 
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symbol  style,  and  no  one  was  admonished  to  print  neatly. 

5.1.2.   Conversion  of  Specimen  to  Binary  Form.   (a)  Photo- 
graphic Enlargement  of  Specimen.   Specimens  on  the  coding  form 
were  photographed  onto  fine-grain  55  nun.  film,  two  specimens 
per  frame,  with  a  magnification  of  5X.   Images  were  then  projected 
onto  special  graph  paper  and  blocked  in  with  crayon.   Magnification 
in  this  procedure  was  lOX,  yielding  an  overall  magnification  of 
5OX.   The  original  0.14"  x  O.I8"  guide  box  enclosing  a  specimen 
was  thus  expanded  to  a  7"  x  9"  field.   Each  7"  x  9"  field  was 
subdivided  by  a  system  of  vertical  and  horizontal  lines  into 
55  columns  and  45  rows,  forming  a  total  of  1575  subfields.   Each 
small  box  represented  a  binary  bit;  a  bit  was  taken  as  being  in 
the  "1"  state  only  if  5O/0  or  more  of  its  area  was  occupied 
by  the  projected  specimen  image.   A  specimen  was  thus  converted 
into  a  sequence  of  binary  bits,  a  binary  "1"  corresponding  to 
specimen  presence  and  a  "0"  corresponding  to  specimen  absence. 

The  number  of  bits  used  to  represent  a  specimen  was  a 
direct  measure  of  system  resolution.   Our  choice  represented 
a  compromise  between  the  need  to  retain  small  but  important 
specimen  features  and  the  expense  and  complication  of  handling 
long  strings  of  bits.   Macroscopic  examination  of  a  large  number 
of  specimens  showed  that  the  average  line-width  encountered 
(pencil)  wa's  12  mils.   It  was  found  that  adequate  detail  could 
be  retained  by  making  this  average  width  correspond  to  three 
bits,  fixing  bit  size  at  4  x  4  mils.   The  total  of  I575  bits 
was  sufficient  to  preserve  small  details  like  the  crossbar  in 
G,  the  curvature  of  a  parenthesis,  and  other  discriminatory 
features. 

(b)   Card,  Tape  and  Storage  Formats.   Conversion  of  a 
specimen  to  IBM  cards  was  accomplished  by  keypunching  directly 
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from  the  blocked-ln  mosaic.   Each  subfleld  on  the  mosaic  was 
numbered:   Subfields  in  rows  1,3,5,...,45  were  numbered  from 
1  to  35 >  beginning  with  the  left  margin;  rows  2, 4, 6,..., 44 
were  numbered  from  37  to  71,  beginning  with  the  left-hand  margin. 
Row  1  corresponded  to  top  of  the  mosaic,  row  45  to  the  bottom. 
See  Fig.  3-2. 

Each  pair  of  rows  was  then  punched  onto  one  IBM  card, 
the  first  of  the  pair  into  columns  1-35,  the  second  into  columns 
37-71  (23  cards  per  specimen).   A  binary  "1"  was  represented 
by  the  BCD  character  "1",  a  binary  "0"  by  a  BCD  blank.   In 
addition,  each  specimen  was  prefixed  with  an  identification 
card  containing  the  specimen  class  and  a  unique  identification 
number  in  the  first  six  columns,  for  a  required  total  of  24  cards 
per  specimen.   This  mode  of  card  usage,  while  grossly  inefficient, 
was  dictated  by  the  requirement  that  keypunching  of  specimens 
be  accomplished  in  a  finite  time.   It  would,  of  course,  be 
unreasonable  to  expect  keypunching  on  a  sustained  basis  of 
multiple-word  binary  cards. 

The  resulting  96OO  keypunched  cards,  representing  400 
specimens,  were  then  converted  to  a  BCD  tape  on  the  IBM-1401. 
The  BCD  tape,  although  much  more  convenient  than  cards,  requires 
excessive  machine  time  to  read  because  of  presence  of  an  inter- 
record  gap  after  each  hollerlth  character.   Accordingly,  the 
BCD  tape  was  converted  to  binary  format  and  used  as  the  400- 
specimen  library  tape.   See  Fig.  3.3.  . 

In  memory,  each  specimen  occupied  a  block  of  45  con- 
secutive 36-blt  machine  words.   Column  1  of  the  mosaic,  corre- 
sponding to  its  left  edge,  was  stored  in  bit  position  1  of  the 
block,  column  2  in  bit  position  2,  etc.   The  sign  bit  was  not 
used,  so  that  the  35  subfields  of  a  row  were  stored  In  bit 
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Flg„  3.2.   Mosaic  with  Specimen  Letter  A, 
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Fig.  3.3.   400-Speclmen  Binary  Library  Tape  Format. 
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Fig.  3.^.   Specimen  Storage  in  IBM  709O  Memory. 
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positions  1-35 .   Specimens  were  stored  In  memory  such  that  top 
of  the  specimen  (row  1,2,...)  corresponded  to  low-order  memory. 
I.e.,  those  machine  words  of  the  block  having  the  smallest 
memory  addresses.   Bottom  of  the  specimen,  row  45,  was  stored 
In  the  word  with  the  largest  memory  address.   In  709O  FORTRAN 
this  word  also  corresponds  to  the  name  assigned  to  the  entire 
block  by  means  of  a  DIMENSION  statement.   See  Fig.  5.4. 

J).1.J>.      Library  Subroutines  and  Function  Package.   A  set 
of  7090  routines  was  devised  to  lighten  the  burden  of  programming 
pattern  recognition  experiments.   Some  of  the  routines  were 
coded  in  709O  FORTRAN,  others  in  FAP,  the  709O  machine  language. 
These  routines  permit  the  execution  of  complex,  frequently- 
needed  operations  and  also  provide  for  rapid  and  efficient 
input-output  by  simple  CALL  statements. 

(a)   Library  Tape  Routines.   These  routines  were  used 
to  generate  and  manipulate  the  binary  library  tape.   The  routines 
are  described  as  follows: 

CONF:   FORTRAN- coded  main  program  to  generate  binary 
tape  of  the  format  shown  in  Fig.  3.3.   Input  is  from  a  BCD 
tape  obtained  by  direct  1401  card-to-tape  conversion.   The 
beginning  of  the  sequence  of  words  representing  a  specimen 
always  represents  the  bottom  of  the  specimen,  row  45.   All  ten 
specimens  of  a  given  symbol  are  written  together  in  a  450-word 
block  and  must  be  read  as  a  block. 

CONV:   FAP  coded  subroutine,  converts  BCD  data  as  obtained 
from  the  input  tape  into  binary  data  and  packs  it  into  standard 
length  36-bit  words,   which  are  then  written  on  tape  by  CONF. 
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INPUT ( NT, NH, 1H-, IH-,. .., SPEC, NASPEC) :   Input  routine 
used  by  the  programmer  to  obtain  data  from  library  tape.   NT 
and  NH  are,  respectively,  the  tape  number  and  number  of  symbols 
desired  from  the  tape.   Symbols  are  specified  by  writing  IH 
followed  by  the  symbol  itself.   Once  a  symbol  is  specified,  the 
entire  block  of  10  specimens  will  be  transferred.   SPEC  is  the 
name  of  the  block  where  the  specimens  are  stored:   450  words 
must  be  provided  for  every  symbol  called.   NASPEC  is  the  name 
of  the  block  where  the  specimen  names  are  stored;  ten  words 
must  be  provided  for  every  symbol  called. 

INPT  (NT,NH,KEY,SPEC,NSPEC) :   Subroutine  called  by  INPUT 
(not  used  directly  by  the  programmer),  finds  and  reads  records 
on  the  library  tape  as  specified  by  INPUT.   The  array  KEY  is 
computed  by  INPUT  and  specifies  which  symbols  are  desired. 

(b)   The  Function  Package.   This  group  of  subroutines 
was  used  to  manipulate  and  process  data  in  storage  in  blocks 
of  NR0W  words  at  a  time.   Various  logical,  graphical,  and 
arithmetic  operations  can  be  performed.   The  constant  NR0W  may 
have  any  value  up  to  and  including  45,  and  must  be  specified 
by  the  programmer.   Similarly,  the  number  of  columns  of  interest 
may  range  up  to  and  including  55,  and  must  also  be  specified  by 
the  programmer. 

All  of  the  routines  described  in  this  part  are  used  in 
conjunction  with  FORTRAN  II  main  programs.   Since  a  group  of 
N  alphanumeric  symbols  was  considered  as  a  two-dimensional 
variable,  the  main  program  must  have  an  appropriate  DIMENSION 
statement.   Thus,  if  we  have  a  group  of  100  mosaics,  each 
45  X  35,  the  main  program  must  have  the  statement 

DIMENSION  SPEC  (45,  100), 
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where  SPEC  is  the  name  used  for  the  two-dimensional  array 
(contraction  of  specimen).   If  we  wish  to  operate  on,  say,  the 
Lth  mosaic,  this  would  he  done  by  using  the  appropriate  sub- 
scripts SPEC  (1,L).   Note  that  in  calling  for  a  two-dimensional 
variable  of  this  form  the  first  subscript  is  always  1.   In  the 
dimension  statement,  the  first  constant  is  simply  the  number  of 
machine  words  per  mosaic.   Whenever  a  particular  mosaic  is  desired, 
it  is  addressed  by  specifying  the  address  of  the  highest  memory 
location  belonging  to  that  mosaic.   Thus  SPEC  (1,2)  is  the 
highest  location  belonging  to  mosaic  2. 

Function  package  subroutines  are  listed  in  Table  3'1> 
and  are  briefly  as  follows: 

DEFINE  (NR0W,  NC0L):   Supplies  necessary  information, 
such  as  number  of  columns  NC0L  and  number  of  rows  NR0W,  to 
all  the  other  subroutines. 

D0  (K,A,B,C):   Computes  the  Kth  logical  function  of  the 
mosaics   A   and  B,   and  stores  the  resulting  mosaic  in  C. 
Thus  if  K  =  7,   the  union  of  the  mosaics,   A  U  B,   is  stored 
in  C.   A  list  of  the  possible  l6  logical  functions  is  given 
in  Table  5.2. 

K0UNT1  and  K0UNTO:   Respectively,  count  the  unit  bits 
and  zero  bits  in  the  specified  mosaic. 

PRINT  (A,NAA,lHb,lHb) :   Prints  a  mosaic   A   in  an 
(NR0W)  X  (NC0L)   format,  similar  as  possible  to  the  original 
image,  to  permit  visual  inspection  of  the  result  of  computations 
on  mosaics.   The  variable  NAA   (contraction  for  "name  of  A") 
is  a  BCD  code  identifying  the  mosaic;  thus  it  could  be  X10,A1,L12, 
signifying  the  10th  specimen  of  the  pattern  X,   etc.   The  first 
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Table  3-^-      Function  Package  Subroutines. 


Subroutine  Name 

Typical  FORTRAN  Statement 

DEFINE 

DEFINE  (NR0W,NC0L) 
CALL  DEFINE  (45,35) 

D0 

D0  (K,A,B,C) 

CALL  D0  (3,SPEC(1,5),SPEC(1,4),SPEC(1,1) ) 

K0UNT1 

KTAT,T,Y  =  K0MT1  (SPEC  (1,1)) 

K0UNTO 

JZER0S  =   KOUNT0  (SPEC  (1,3)) 

PRINT 

PRINT  (A,NAA,lHb,lHb) 

CALL  PRINT  (SPEC  (1,1),  NASPEC  (l),  1H0,  IH. ) 

GETBIT 

GETBIT  (I,J,A,K) 

CALL  GETBIT  ( 3, 24 , SPEC( 1, 1 ) ,K) 

ST0BIT 

ST0BIT  (I,J,A,K) 

CALL  ST0BIT  (1,1,  SPEC  (1,1),  0) 

READ 

READ  (A,NAA,K) 

CALL  READ  (SPEC  (1,3),  NASPEC  (3),  5) 

IZR0W 

IZR0W  (A, I) 

Kl  =  IZR0W  (SPEC  (1,5),  23) 

IZC0L 

IZC0L  (A, J) 

K2  =  IZC0L  (SPEC  (1,3),  5) 

XDUMP 

XDUMP  (A,B,I) 

CALL  XDUMP  (100,30000,3) 
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Table  3.2.   Logical  Functions  in  D0  Subroutine. 


K 

D0    (K,A,B,C) 

0 

0 

1 

An  B 

2 

AD  (-B) 

3 

A 

4 

(-A)  r)B 

5 

B 

6 

(AD  (-B))    ((-A)nB) 

7 

A  UB 

8 

-(aUb) 

9 

(A  Hb)  U  (-(a  Ub)) 

10 

-B 

11 

A  U  (-B) 

12 

-A 

13 

(  -A  )  VJ  B 

ih 

-(A  OB) 

15 

1 
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hollerlth  variable  specifies  the  printer  symbol  to  be  associated 
with  a  zero  bit  in  the  mosaic,  while  the  second  hollerlth 
variable  specifies  the  printer  symbol  to  be  associated  with  a 
unit  bit.   This  subroutine  does  not  access  the  printer  directly 
but  through  the  standard  output  tape  as  used  in  the  MONITOR 
system. 

GETBIT  (I,J,A,K):  Sets  the  variable  K  equal  to  the 
value  of  the  bit  in  mosaic  A  located  in  the  Ith  row  and  Jth 
column.   Thus,   K  may  be  either  "0"  or  "1". 

ST0BIT  (I,J,A,K):   Where  K   is  given,  addresses  the  bit 
in  mosaic  A  located  at  row  I   and  column  J,   and  sets  it 
equal  to  the  given  value  of  K. 

READ  (A,NAA,K):   A  temporary  subroutine;  permitted  the 
use  of  BCD  cards  (originally  prepared  for  use  with  the  704) 
as  input  to  a  recognition  program.   In  actual  practice,  cards 
would  be  converted  to  a  BCD  tape  with  the  tape  number  K   speci- 
fied in  the  CALL  statement.   (Since  one  ^5  x  55  mosaic  requires 
24  BCD  cards,  an  appreciable  number  of  specimens  requires  an 
unwieldy  quantity  of  cards  and  a  correspondingly  long  time  to  be 
read  into  the  machine.) 

IZR0W  (A, I):  Examines  the  Ith  row  of  the  mosaic  A. 
If  the  row  has  at  least  one  nonzero  bit,  the  function  is  set 
equal  to  "1",  otherwise  it  is  "0". 

IZC0L  (A, J):  Performs  an  analogous  function  for  the 
Jth  column. 

XDUMP  (A,B,I):   Subroutine  used  for  debugging.   The 
decimal  niombers  A  and  B   specify  lower  and  upper  limits  of 
a  block  of  memory  which  is  to  be  printed  in  a  format  specified 
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by  the  integer   C.   If   C  =  3>   the  dump  is  octal-mnemonic. 

3.1.4.   Hollerith-to-Column  Binary  Punch  Routine,  PUNCH 
(A,K,NCHAR) .   Although  the  interim  library  consisted  of  only 
400  specimens,  it  required  4-00  x  24  or  nearly  10,000  cards  — 
a  stack  nearly  six  feet  in  length.   Use  of  binary  cards  offered 
an  attractive  advantage  in  space  and  handling  requirements: 
Since  one  binary  card  can  store  up  to  24  words,  only  two  cards 
per  specimen  were  required,  a  twelve-fold  improvement. 

The  PUNCH  routine  punches  a  specimen  onto  a  pair  of 
column  binary  cards.   The  first  card  contains  rows  1-24  of  the 
specimen  in  columns  1-72.   Each  row  occupies  three  columns; 
row  1  is  punched  in  columns  1,  2,  and  3j  etc.   The  second  card 
contains  rows  25  to  45  of  the  mosaic  in  columns  1-63-   This  card 
also  contains  the  specimen  name  or  identification  in  coliomns 
67-7O:   Column  67  contains  the  symbol  name,  such  as  A,  Q,  3,  ), 
etc.;  column  68  contains  a  dash;  the  last  two  columns  together 
contain  an  integer  ranging  from  1  to  50.   Note  that  the  second 
card  contains  data  in  both  binary  and  holler ith  formats,  and 
that  neither  card  has  storage  address,  either  absolute  or 
relative,  associated  with  it. 

3«2.   Experiments  with  45  x  35  Handprinted  Alphanumeric  Characters 

3.2.I.   Introduction.   Section  2  described  the  results  of 
some  preliminary  recognition  experiments  using  coarsely  quantized 
"unrealistic"  symbols.   This  section  reports  results  of  experiments 
using  handprinted  symbols  rather  finely  quantized  into  1575  bits 
(35  X  45  mosaic) . 

The  recognition  schemes  which  have  been  previously 
described  place  conflicting  requirements  upon  the  masks.   If  all 
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specimens  of  a  class  are  Identical  in  shape  and  position,  then 
the  mask  for  that  class  should  include  only  that  area  occupied 
by  one  of  the  (all  identical)  specimens,  and  no  more.   That  is, 
the  mask  should  be  as  small  in  terms  of  area  as  possible  to 
exclude  all  specimens  not  belonging  to  its  class.   In  general, 
however,  there  is  lack  of  identity  either  in  position  or  shape 
or  both;  if  a  mask  is  constructed  by  taking  some  single  "typical" 
specimen  of  a  class,  it  is  very  likely  that  other  nonidentlca] 
members  of  the  same  class  will  be  blocked  as  effectively  as  if 
they  were  members  of  a  different  class.   Hence,  it  was  necessary 
to  increase  the  area  of  the  mask  enough  to  include  the  other 
specimens  of  its  class  but  not  so  much  as  to  admit  undesired 
specimens.   This  increase  was  accomplished  by  taking  the 
loglcal-OR  of  several  specimens,  either  at  random  or  according 
to  some  criterion.   The  results  of  Section  2  show  that,  with  the 
methods  used,  these  requirements  conflict  so  strongly  that  even 
the  best  compromise  provides  a  recognition  rate  under  50 /o.   It 
is  impossible  to  open  up  the  masks  enough  to  recognize  a  sub- 
stantial portion  of  the  specimens  in  a  class  without  also  admit- 
ting many  undesired  ones. 

One  possible  solution  to  this  dilemma  would  be  somehow 
to  operate  on  the  specimens  to  make  them  look  more  like  their 
respective  masks.   An  unknown  specimen  would  first  undergo 
processing  (which,  of  course,  must  be  independent  of  the  unknown 
specimen)  and  then  be  presented  to  the  masks.   Alternatively,  the 
processing  could  be  interspersed  with  presentations  to  the  masks, 
with  results  of  the  presentations  used  as  criteria  of  continued 
processing. 


It  is  not  at  all  clear  that  such  a  specimen  exists, 
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5.2.2.   Problems  8  and  9.   The  Interspersed-presentation 
method  was  used  In  Problems  8  and  ^.      A   total  of  30  handprinted 
specimens  representing  classes  E,  F,  X  were  used  in  these 
problems,  and  masks  were  generated  by  taking  the  logical-OR 
of  all  the  specimens  (10  per  class).   The  steps  were  as  follows, 
where  AND  and  OR  are  logical  operations: 

(1)  Unknown   AND  MSK  =  W, 

(2)  W  OR  BSK  [BSK  was  initially  cleared,  all  zeros], 

(3)  [Compute]   FRAG  =  |^^jggj^j  , 

(4)  [Specimen   (W  OR  BSK)   was  randomly  shifted  in 
vertical  and  horizontal  directions,] 

(5)  (W  OR  BSK)  [Shifted]  AND  MSK  =  W, 

(6)  W  OR  BSK 

(7)  [New  value  of  FRAC  computed.] 

It  is  clear  that  BSK  will  gradually  approach  the  array  MSK  as 
a  limit  and  that  FRAG  will  approach  1.   The  hypothesis  made 
was  that  the  quantity  FRAC  corresponding  to  the  correct  pattern 
class  would  increase  faster  than  all  the  others,  so  that  if 
the  process  was  terminated  before  all  of  the  quantities  had 
approached  1.0,  the  value  of  FFIAG  corresponding  to  the  correct 
class  would  be  a  maximum.   Shifting  and  computation  were 
performed  40  times  for  each  unknown. 
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Fig.  3.5  shows  the  results  of  ProTDlem  8.   The  thresholds 
In  (a)  were  computed  before  any  shifting.   Specimens  E3,  F3,  X3 
were  used  as  the  unknowns  in  the  shifting  process  in  (b).   It 
will  be  noted  from  (a)  that  Thresholds  2  and  3  seem  particularly 
effective;  in  (b)  it  is  clear  that  the  shifting  operation  was 
not  very  effective,  possibly  invalidating  the  method. 

Fig.  3.6  tabulates  results  of  Problem  9  which  was 
identical  to  Problem  8  except  that  initially  all  specimens  were 
shifted  to  the  lower  left  margins  as  far  as  possible  in  an 
attempt  to  reduce  dispersion  due  to  position  differences. 
Contrary  to  expectations,  performance  based  on  thresholds 
deteriorated;  the  shifting  process  was  not  affected. 

3.2.5.   Problem  10.   Since  Thresholds  2  and  3  seemed  to 
be  effective,  the  recognition  process  of  Problems  8  and  9  was 
modified.   The  quantity  FRAC  was  replaced  by  two  others  defined 
as : 

FRAC  2  =  KACMSkHs)   ^      pp^^  ^  ^  KA(MSKr)S) 
KA(MSK)     '  KA(MSK) 

where  the  numerators  are  the  initial  values  before  shifting. 
After  each  shift,  the  array  MSK  O  S   was  generated,  where 
S   represents  the  specimen  after  n   shifts.   This  array  was 
then  OR'd  with  BSK  and  used  as  the  numerator  to  compute  new 
values  of  FRAC  2  and  FRAC  3.   After  two  shifts  the  numerator 
is 

[(MSKDS^)  U  [(MSKnS^)U[(MSKnSQ)  VJbSk]11  . 

In  Problem  10,  only  20  shifts  were  used  since  Problems 
8  and  9  showed  that  the  FRAC  values  converged  fairly  rapidly. 
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Pig.  3'5'   Results  of  Prohlem  8.   Ten  specimens  each  of 
E,  F,  X.   Masks  are  the  logical-OR  of  ten 
specimens.   Thresholds  computed  before  shifting. 
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Fig.  3.6.   Results  of  Problem  9.   Same  problem  as 

Problem  8  except  that  all  specimens  were 
shifted  to  lower  left-hand  corner. 
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Fig.  3.7  shows  some  of  the  results  obtained.   Each  specimen  was 
used  as  an  input,  rather  than  the  three  used  in  Problems  8  and  9. 
In  (a)  the  masks  were  randomly-chosen  single  specimens;  the 
first  table  shows  the  computed  thresholds  before  random  shifts, 
while  the  second  table  shows  the  results  of  processing  the 
unknowns.   After  20  shifts,  performance  deteriorated  slightly. 
Part  (b)  shows  results  when  masks  were  single  specimens  chosen 
on  basis  of  performance  in  (c).   Results  before  shifting  are 
poor,  but  the  shifting  process  did  improve  the  initial  score 
by  approximately  20*/^o  .   This  example  clearly  shows  that  the 
masks  chosen  can  be  crucial  to  success  or  failure  of  the 
shifting  process. 

3.2.4.   Mask  Generation.   Parameter  of  FREQ.   At  this 
point  a  more  rational  way  of  generating  masks  was  badly  needed. 
A  study  was  made  of  the  statistical  distribution  of  area  in 
the  specimens  and  of  written  subroutines  that  generate  masks 
using  a  probability  threshold.   Thus,  the  E  mask  would  be 
generated  by  first  computing  the  two-dimensional  probability 
distribution  for  all  of  the  E  specimens.   A  parameter  FREQ  would 
then  be  specified,  and  the  mask  generated  bit  by  bit.   Hence,  if 
FREQ  were  specified  as  2,  a  given  bit  in  the  mask  would  be 
made  a  "1"  only  if  that  particular  bit  position  had  been  filled 
in  two  or  more  of  the  specimens.   Clearly,   FREQ  =1   is  the 
same  as  the  OR  of  all  of  the  specimens,  while   FREQ  =  10   is  the 
same  as  taking  the  AND  of  all  (ten)  specimens.   It  was  found 
that  specimens  of  a  given  class  usually  exhibited  so  much  dis- 
persion in  size  and  shape  that  FREQ  =  1   resulted  in  an  array 
almost  entirely  filled,  while  FREQ  =  10  resulted  in  perhaps 
three  bits  remaining  "1". 

Fig.  3.7  (c),  (d),  and  (e)  show  results  obtained  when 
masks  were  generated  by  FREQ  values  of  1,  2,  3,  respectively. 
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(a)  Randomly  chosen  single  specimens  used  for  masks. 
does  not  improve  performance. 


Shifting  process 


Thres- 

hold 

E 

F 

X 

/o  Correct 

Tl 

k 

4 

6 

47 

T2 

6 

3 

6 

50 

T3 

6 

3 

6 

50 

T4 

2 

10 

2 

47 

Thres- 

No. of 

hold 

Shifts 

E 

F 

X 

/o  Correct 

T2 

0 

6 

3 

6 

50 

20 

10 

4 

8 

73 

T3 

0 

6 

3 

6 

50 

20 

10 

1 

10 

70 

(h)  Single  specimens  used  for  masks,  chosen  on  basis  of  hest 
performance  in  a  run  using  OR  of  all  specimens  as  masks. 
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Fig.  3.7.   Problem  10. 
(Continued  on  next  page.) 
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(d)  Masks  generated  with  FREQ  =  2. 
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(e)  Masks  generated  with  FREQ  =  3. 


Fig.  3«7«   (Continued.) 
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Note  that  the  shifting  process  Is  a  detriment.   Performance 
obtained  with  Thresholds  2  and  3  "before  shifting  Is  considerably 
better  than  that  obtained  after  shifting  and  at  much  less  cost. 

Masks  which  had  been  used  up  to  this  point  In  the  study 
were  all  derived,  directly  or  indirectly,  from  specimens.   It  is 
possible  to  take  the  viewpoint  that  performance  is  a  function 
of  1575  binary  variables.   Then  performance  for  each  of  the 
2  -^ ' -^  =  10    values  taken  by  the  Independent  vector  could  be 
computed,  retaining  that  combination  which  resulted  in  best 
performance.   However,  this  approach  is  not  practical;  although 
some  kind  of  random  search  procedure  might  be  used.  Implementing 
instrumentation  for  an  actual  recognition  device  would  be  pro- 
hibitive . 

3. 2.5.   Problem  11.   It  appeared  that  certain  portions 
of  the  mosaic  are  more  Important  than  others  in  recognition  of 
certain  letters;  that  is,  the  lower  right-hand  quadrant  should 
be  more  Important  than  other  quadrants  for  "E"  and  "F".   In 
Problem  11  the  mosaic  was  broken  up  into  six  partitions  to  test 
this  supposition.   Fig.  3.8  presents  these  results.   Thresholds 
1  and  2  were  used  as  well  as  their  sum,  and  FREQ  =  3  was  chosen. 
Paradoxically,  Partition  5  was  seen  to  be  much  more  effective 
than  Partition  6.   The  reason  for  this  is  not  clear. 

3' 2. 6.   Problem  12.   Problem  12  was  similar  except  that 
Thresholds  1  and  2  were  redefined  as 
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Fig.  5.8.   Problem  11. 
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The  sum  therefore  reduces  to  the  excluslve-OR  divided  by  1575 . 
Fig.  3.9  depicts  the  results  of  using  THl,  TH2,  the  s\im,  and 
masks  generated  with  FREQ  =  1.   The  fact  that  none  of  the 
partitions  Is  very  effective  Is  shown  In  (a);  the  best  performance 
Is  only  60%  obtained  with  P6  of  TH2. 

It  Is  possible,  however,  to  combine  results  of  the 
various  partitions  In  such  a  way  as  to  enhance  the  score.   Two 
ways  of  doing  this  are  shown  In  Fig.  3«9  (b).   Both  methods, 
used  with  TH2,  resulted  In  scores  of  over  90/0.   The  columns 
titled  "majority  of  6"  were  obtained  as  follows:   Since  each 
partition  Indicates  that  a  given  unknown  belongs  to  a  certain 
class  (or  possibly  to  several  classes  If  there  Is  more  than  one 
maximum),  the  "correct"  class  was  taken  as  the  one  having  majority 
representation  among  the  six  partitions.   Thus,  If  the  partition 
scores  Indicate  that  an  unknown's  classifications  were  (say) 
E,  F,  F,  EX,  X,  E,   the  unknown  was  taken  to  be   E   since  E 
was  represented  three  times,   F  twice,  and  X   twice.   In  like 
manner,  the  columns  titled  "majority  of  best  4"  were  obtained 
by  deleting  the  worse  two  partitions  and  applying  the  decision 
process  to  the  remaining  four. 

Fig.  3*10  Is  similar  to  Fig.  3.9  except  that  the  masks 
were  generated  for  FREQ  =  3*   Individual  partition  scores  were 
greatly  Improved;  however  the  majority  procedures  were  less 
effective.   In  comparing  Fig.  3*10  and  Fig.  3*8  It  Is  clear  that 
Thresholds  Tl  and  T2  were  more  effective  than  the  revised  Thres- 
holds THl  and  TH2. 

3.2.7.   Problems  I3  and  l4 .   Problems  I3  and  l4  represented 
an  attempt  to  Improve  partition  performance  by  using  larger, 
overlapping  partitions.   Fig.  3.11  (b)  shows  the  geometry  of  the 
partitions;  (a)  shows  that  these  partitions  were  effective  --  p6 
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Fig.  5.9.   Problem  12,  FREQ=1,  Modified  Thresholds, 
Su]Ti=  ( Exclusive-OR  )/l575 . 
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Pig.  3.10.   Problem  12,  FREQ=3,  Modified  Thresholds, 
Sum= ( Ex c lu s i ve - OR ) /15 75 . 
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for  the  sum  actually  achieves  lOO^o  recognition. 

The  decision  procedure  does  not  appreciably  Improve  the 
scores.   When  FREQ  was  raised  to  3  In  (c),  performance  deteriorated, 
especially  on  the  Individual  partitions.   Fig.  3. 12  is  analogous 
to  Fig.  3.11  except  that  modified  Thresholds  THl  and  TH2  were 
used.   For  FREQ  =  1   the  use  of  the  modified  thresholds  resulted 
in  a  marked  reduction  in  performance;  for  FREQ  =  3   the  reduction 
was  much  less. 

3.2.8.  Problem  15 .   The  results  of  the  test  series  with 
1575-'blt  specimens,  while  illuminating,  do  not  indicate  what 
performance  might  be  obtained  with  a  larger  number  of  specimens. 
Intuitively,  one  expects  that  the  greater  number  of  conflicting 
requirements  would  result  in  a  reduction  of  performance.   In 
Problem  15,  ten  samples  of  each  of  the  pattern  classes  B,C,D, 
E,F,G,I, J,0,X  were  used.   Six  overlapping  partitions  in  conjunction 
with  T2   constituted  the  decision  procedure.   The  results  of 
Problem  15  are  tabulated  in  Fig.  3»13j  and  as  expected,  performance 
for  ten  patterns  was  poorer  than  for  three.   Fig.  3.14  compares 
performance  obtained  with  three  patterns  to  that  of  ten  patterns, 
using  T2.   The  best  performance  of  64/o  obtained  for  ten  patterns 
was  produced  by  P4  used  in  conjunction  with  T2  and  FREQ  =  3. 

3.2.9.  Problem  16.   In  Problem  16,  the  dispersion  of 
the  high  probability  areas  of  the  masks  was  investigated.   The 
masks  for  the  ten  pattern  classes  were  generated  using  FREQ  =  7 
and  the  palrwise  dispersion  calculated  according  to  the  definition 
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Fig.  3.13.   Results  of  Problem  I5.   Percentage  of 
Correct  Identifications,  Using  T2. 
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If  the  two  masks  were  identical,   D  =  10;   If  they  were  disjoint, 
D  =  0.   The  results  of  this  calculation  are  tabulated  in  Pig.  3«15. 
On  a  pairwise  basis,  the  masks  were  well  disjoint;  the  greatest 
overlap  was  between  I   and  0  for  which  D  was  0.35*   If  one 
makes  the  assiomption  that  the  mask  area  appears  in  its  entirety 
in  seven  out  of  ten  specimens  (FPIEQ  =  7)  then,  since  in  Fig.  3.15 
the  highest  overlap  was  only  35%,    it  is  possible  to  say,  roughly, 
that  70/0  recognition  should  be  possible  using  an  occupied  area 
criterion  (Tl)  and  FREQ  in  the  neighborhood  of  7. 

3.2.10.  Problem  17 .   The  results  of  Problem  17  (Fig.  3.I6) 
verified  this  supposition.   Threshold  Tl  was  used,  which  measured 
deviation  from  the  unit  bits  of  the  mask.   Note  that  performance 

is  at  its  maximum  over  the  range   3  <_  FREQ  <   J.      There  is  not 
much  variation  in  the  masks  over  this  range,  which  explains  the 
essentially  constant  performance. 

3.2.11.  Conclusions  from  Prior  Problems.   Up  to  this 
point  the  number  of  masks  had  been  limited  to  ten.   The  advantages 
of  having  only  one  mask  per  pattern  class  are  obvious  --  less 
storage  is  required  in  the  recognition  device.   However,  it  is 
equally  clear  that,  with  the  methods  used,  restriction  to  one 
mask  per  class  led  to  a  performance  that  never  exceeded  about 
70%.   It  is  quite  likely  that  addition  of  new  pattern  classes 
would  reduce  this  figure  even  more.   It  should  be  emphasized 

that  the  mediocre  performance  obtained  is  attributable  to  the 
size  and  shape  distortion  characteristic  of  handprinted  letters. 
The  methods  employed  should  be  very  effective  for  machine-printed 
characters  used  in  conjunction  with  some  kind  of  centering  device. 
Since  it  does  not  seem  feasible  to  develop  a  standardizing  pro- 
cedure that  removes  distortion  (essentially  equivalent  to  solving 
the  pattern  recognition  problem)  another  alternative  is  to  in- 
crease the  niomber  of  masks.   However,  using  a  mask  for  every 
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conceivable  input  specimen  is  neither  practical  nor  possible, 
since,  in  general,  specimens  from  all  people  whose  printing 
must  he  recognized  will  not  he  available  to  us.   In  addition, 
memory  requirements  become  prohibitive. 

5.2.12.   Problems  I8,  19,  and  20.   Problems  18,  19,  and 
20  were  investigations  into  the  feasibility  of  compromise 
solutions.   An  attempt  was  made  to  generate  a  set  of  masks  for 
each  pattern  using  certain  criteria  described  below. 

Two  methods  of  mask  generation  were  tried;  these  will 
be  referred  to  as  Method  I  and  Method  II.   As  before,  ten  speci- 
mens of  each  of  the  patterns  B,C,D,E,F,G,0,I, J,X  were  used. 
Consider  one  particular  pattern  class;  let  its  specimens  be 
denoted  by  S-,  ,Sp, . . .  ,S-,  ^.   Let  M,  ,Mp,...,M   be  the  masks.   The 
masks  as  well  as  the  number  needed  are  unknown  at  this  point. 

Method  I.   The  first  mask  is  set  'equal  to  the  first 
specimen,   M-,  =  S^  .   The  next  specimen  Sp   is  then  used  to 
generate  the  expression  below.   (P  is  a  parameter  whose  value 
ranges  from  0  to  1.0.) 

KA(M^)    ^  y  i  J  (  KATS^T"  ~  ^ 

If  the  expression  is  true,   M  O  Sp  replaces  M, .   If  not,   Sp 
becomes  a  new  mask  Mp.   The  process  is  repeated  until  all  ten 
specimens  have  been  examined.   Depending  upon  P  and  upon  the 
specimens,  the  nimiber  of  masks  n  may  range  anywhere  from  0  to 
10.   If  all  the  specimens  are  identical,   n  =  1.   As  the  procedure 
progresses,  there  will  usually  be  a  point  at  which  several  masks 
are  present.   The  incoming  specimen  is  always  compared  with  the 
masks  sequentially.   M^   is  tried,  if  this  fails  Mp   is  tried, 
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and  so  on.   As  soon  as  a  mask  satisfies  the  criteria,  the  search 
stops  and  the  next  specimen  Is  brought  In,  starting  again  with  M-.  , 
The  procedure  always  guarantees  that  for  any  specimen  a  mask  will 
exist  such  that  the  overlap  expressed  as  a  percentage  of  either 
the  mask  or  the  specimen  Is  greater  than  P/o. 

Method  II.   This  method  Is  similar  to  Method  I,  except 
that  only  one  condition  must  be  met,  namely 

KA(M-^n  Sg) 

KA(M^)    -  ^ 

If  this  expression  Is  true,  M  remains  unchanged  (I.e.,  remains 
S^ )  and  S_  Is  tried.  If  the  expression  Is  false,  Sp  becomes 
Mg.   The  procedure  Is  continued  for  all  ten  specimens. 

Method  II  has  the  advantage  over  Method  I  that  all  masks 
remain  more  or  less  constant  in  size.   In  Method  I,  the  masks 
continually  shrink,  so  that  the  two  required  conditions  are 
progressively  harder  to  meet.   Fig.  3.17  shows  curves  of  total 
masks  generated  (for  a  100-specimen  problem)   versus  values  of 
the  parameter  P.   For  a  given  P,   as  predicted.  Method  I 
required  a  great  many  more  masks. 

J>.2.1J>,      Problems  21  and  22.   The  masks  generated  by 
Method  II  were  tested  for  performance  in  Problems  21  and  22. 
In  Problem  21,  the  excluslve-OR  was  used  as  a  discrimination 
function,  while  in  Problem  22  Threshold  Tl  was  used.   The  results 
are  presented  in  Fig.  ^-iS,  from  which  it  may  be  seen  that  this 
method  of  mask  generation  is  not  too  satisfactory.   To  achieve 
50/0  recognition  required  about  25  masks;  the  same  figure  was 
previously  reached  and  in  some  cases  surpassed  by  using  only 
ten  masks  (one  per  class). 
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DISCRIMINATION 
FUTJCTION 

P 

NO.  OF  MASKS 

%   CORRECT 

EXC.-OR 

.40 

25 

54 

.70 

79 

96 

Tl 

.30 

18 

47 

.40 

25 

50 

.50 

45 

71 

Pig.    3.18.      Problems   21   and   22. 


B 

c 

D 

E   F 

G 

I 

J 

0  X 

TOTAL 
MASKS 

%  CORRECT 
RECOGNITION 

ORIGINAL  NUMBER 
OF  MASKS 

3 

3 

3 

3  3 

2 

2 

3 

2   1 

25 

50 

INCREMENT 

6 

1 

4 

7  2 

7 

5 

2 

8  8 

50 

TOTAL 

9 

4 

7 

10  5 

9 

7 

5 

10  9 

75 

93 

Fig.    3.19. 
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One  further  test  was  made  using  the  many-masks  approach. 
The  characters  Incorrectly  recognized  In  one  of  the  tests 
summarized  in  Pig.  3.I8  (for  Tl  and  P  =  .^0)  were  tabulated  and 
each  incorrectly  recognized  specimen  was  Introduced  as  an  additional 
mask  to  the  original  set  of  25.   Since  there  had  heen  50  errors, 
50  new  masks  were  added,  resulting  in  a  total  of  75'   This  new  set 
of  masks  was  then  tested  using  Tl,  resulting  in  seven  errors.   The 
detailed  results  are  shown  in  Fig.  3.19* 

3.3«   Concluding  Comment 

The  results  of  the  series  of  experiments  showed  that  the 
"best  performance  which  can  be  obtained  using  area-matching 
schemes  is  in  the  vicinity  of  65/0-75/0.   Although  area-matching 
methods  have  the  important  advantage  of  being  readily  instrumented, 
the  recognition  performance  obtained  through  their  use  was  not 
sufficiently  high  to  permit  their  effective  application  to  the 
problem  of  handprinted  characters. 

k.      FLYING  SPOT  SCANNER  INPUT 

k .1.    General 

The  flying  spot  scanner  input  device  was  designed  to 
automate  the  process  of  converting  alphanumeric  specimens  to 
binary  punched-card  format.   See  Fig.  4.1.   It  consisted  of  a 
cathode  ray  tube  together  with  associated  deflection  and  timing 
circuitry,  an  optical  system  for  focusing  the  CRT  raster  onto  the 
specimen,  as  adjustable  specimen  holder,  a  modified  IBM  cardpunch, 
an  aiijclliary  memoscope  display  tube,  and  a  photomultlpller. 

Input  to  the  scanner  was  in  the  form  of  printed  strips 
one  character  high;  a  strip  was  manually  positioned  until  the  CRT 
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raster  was  centered  on  the  specimen  field,  as  indicated  by  an 
auxiliary  memoscope  CRT  display.   Once  centered,  a  punch  cycle 
was  initiated.   During  this  cycle,  the  scanner  output  was  coupled 
to  the  cardpunch,  converting  the  specimen  into  two  colijmn  binary 
cards.   Using  this  technique,  the  specimen  library  was  augmented 
by  an  additional  16OO  specimens,  at  an  average  conversion  rate 
of  5O-7O  specimens  per  hour,  a  rate  dictated  by  speed  of  the 
cardpunch  machine  and  specimen  set-up  time. 

4.2.   System  Design 

4.2.1.   Scanner.   The  raster  generator  consisted  of  a 
modified  Tektronix  Type  360  indicator.   Vertical  and  horizontal 
deflection  voltages  were  provided  by  a  pair  of  digital-to-analog 
converters,  driven  by  a  Y-axis  counter  and  an  X-axis  counter, 
respectively.   These  voltages  were  applied  to  the  tube  through  the 
deflection  amplifiers,  since  the  outputs  of  the  D-A  converters 
were  small. 

The  X-axis  counter  was  used  to  store  the  column  count, 
a  binary  number  ranging  from  0  to  34.   This  niomber  controlled 
the  horizontal  position  of  CRT  beam.   Reception  of  a  35th  clock 
pulse  reset  the  counter  to  zero  and  transmitted  an  output  pulse 
to  the  Y-axis  or  row  counter.   The  row  counter  stored  a  binary 
number  ranging  from  0  to  44.   Reception  of  a  45th  pulse  from  the 
X-axis  counter  reset  it  to  zero  and  transmitted  an  output  pulse 
which  terminated  the  cycle. 

The  rate  at  which  the  system  operated  was  limited  by  the 
mechanics  of  the  card  punch.   A  10-Kc  clock  was  found  to  be 
satisfactory.   In  operation  12  subflelds  (bits)  of  the  specimen 
were  scanned  at  a  10-Kc  rate,  the  results  stored  in  a  12-flipflop 
buffer,  and  the  scan  stopped  while  the  contents  of  the  buffer 
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were  punched  onto  one  column  of  the  card.   The  punch  itself 
provided  an  end-of -punch  signal  which  restarted  the  scan. 
Approximately  20  seconds  were  required  for  a  complete  specimen 
cycle. 

Because  of  the  slow  clock  rate,  it  was  possible  to  use 
the  high  intensity  Pll  phosphor  which  has  a  10  nsec  decay  time, 
found  to  be  entirely  adequate.   Initially  the  very  fast  Pl6 
phosphor  was  tried,  but  relatively  low  output  resulted  in  low 
slgnal-to-noise  ratios.   In  order  to  prevent  phosphor  damage, 
pulsed  beam  operation  was  used. 

4.2.2.  Optics.   A  reducing  lens  was  used  to  focus  the 
CRT  raster  image  onto  the  specimen.   Lens,  specimen  holder  and 
CRT  were  all  mounted  on  a  standard  optical  rail.   The  lens  was 
contained  in  a  light-proof  enclosure  which  also  contained  the 
photomultiplier  tube  and  specimen  holder.   A  bakelite  tube 
between  lens  and  CRT  blocked  all  stray  illumination  not 
originating  from  the  CRT  face. 

Raster  size  on  the  CRT  face  was  1.26"  by  O.98";  when 
demagnified  by  a  factor  of  seven  by  the  reducing  lens,  the 
required  specimen  field  of  O.I8"  by  0.l4"  was  obtained.   The  lens 
employed  was  a  Leitz  f  2.5  projector  lens  with  a  focal  length  of 
10  cm.   A  long  focal  length  was  selected  in  order  that  the 
intensity  of  the  spot  image  remain  constant  regardless  of  its 
position  within  the  specimen  field.   Spot  size  at  the  specimen 
was  calibrated  and  adjusted  with  a  measuring  microscope  to 
approximately  0.004". 

4.2.3.  Photomultiplier  Pickup.  A  photomultiplier  tube 
was  used  to  monitor  the  light  reflected  from  the  surface  of  the 
specimen.   The  photomultiplier  output  was  amplified  and  sent  to  a 
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threshold  detector  for  decision.   High  output  resulted  In  a 
binary  "0",  while  low  output  meant  that  the  heam  was  being 
interrupted  by  a  pencil  line,  resulting  in  binary  "1".   Tube  out- 
put was  approximately  7  \i   amps  for  a  "0"  and  2  \x   amps  for  a  "1". 

4.2.4.  Display.   A  Hughes  memoscope  was  used  to  monitor 
and  display  the  photomultiplier  output.   The  memoscope  deflection 
circuitry  was  driven  by  the  same  voltages  used  to  generate  the 
scan  raster.  Beam  intensity  was  modulated  by  the  threshold 
detector  output,  so  that  the  displayed  pattern  corresponded 
exactly  with  the  output  of  the  card  punch.   The  memoscope  display 
proved  invaluable  for  specimen  centering,  detection  and  rejection 
of  incorrectly  punched  cards,  and  for  optimum  adjustment  of  photo- 
multiplier  sensitivity  and  threshold  detector  levels. 

4.2.5.  Card  Format  and  Punch  Modification.   A  specimen 
was  quantized  into  45  rows  each  containing  35  bits.   In  core 
storage  (709O),  each  row  occupied  one  machine  word.   The  bits 
were  right-adjusted,  so  that  the  sign  bit  was  never  used. 

The  output  of  the  scanner-controlled  card  punch  consisted 
of  two  column-binary  cards.   Card  one  contained  rows  1  through 
24,  while  card  2  contained  rows  22  through  45.   Each  image  row 
occupied  three  card  columns,  thus  image  row  1  was  punched  in 
columns  1,  2,  and  3?  i^ow  2  in  columns  4,  5,  6,  etc.   Each  image 
row  was  considered  to  begin  with  a  "0"  bit  which  occupied  the 
top  row  of  columns  1,  4,  7,    ...,  on  the  card,  i.e.,  the  sign  bit. 
Specimen  identification  was  manually  punched  into  columns  67-71 
of  the  second  card. 

An  IBM  024  card  punch  was  modified  for  operation  with  the 
scanner.   In  this  device,  normal  operation  required  card  registra- 
tion followed  by  manual  depression  of  one  of  the  keyboard  buttons. 
This  in  turn  energized  an  interposer  magnet  and  initiated  the 
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space-punch  cycle.   The  interposer  magnets  are  normally  dis- 
connected from  the  power  source;  during  the  punch  cycle  a  cam- 
operated  switch  applied  B+  simultaneously  to  all  12  magnets. 
Ground  return  was  obtained  through  controlled  rectifiers  driven 
hy  a  12-lDit  buffer  memory  containing  the  photomultiplier  output. 
Only  those  controlled  rectifiers  driven  by  "1"  bits  were  turned 
on,  energizing  the  corresponding  interposer  magnets. 

Energization  of  all  12  magnets,  which  occurs  during 
scanning  of  densely  penciled  specimens,  was  found  to  cause 
erratic  and  unreliable  punch  operation.   The  punch  cycle  was 
accordingly  divided  into  two  subcycles  to  permit  a  maximum  of 
only  six  magnets  to  be  energized  at  a  given  time.   A  punch  cycle 
thus  consisted  of  the  following:   The  card  was  first  advanced 
by  one  coliomn,  and  then  the  appropriate  interposers  in  the  first 
six  rows  energized.   During  the  second  subcycle,  the  operation 
was  similar  except  that  the  card  was  not  advanced. 

5.   2000- SPECIMEN  BINARY  LIBRARY  TAPE 

5.1.  Introduction 

The  original  400-specimen  library  was  augmented  by  the 
flying  spot  scanner,  described  in  Section  4,  to  bring  the  library 
to  a  total  of  2000  specimens.   Of  hO   symbols,  5O  samples  of  each 
were  included,  representing  specimens  of  handprinting  from  50 
different  persons.   These  samples  were  stored  on  4000  IBM  cards 
occupying  approximately  2.5  feet  of  shelf  space. 

5.2.  The  Binary  Library  Tape 

To  permit  rapid  and  convenient  input,  the  specimen  library 
was  converted  to  a  binary  tape.   A  flow  chart  of  this  process  as 
described  below  appears  in  Fig.  5.1. 
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Fig.  5.1.   Flow  Chart  of  Specimen  Conversion  to  Binary  Tape 
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The  first  step  In  this  process  was  to  convert  the  original 
4 00- specimen  tape  library  to  a  card  library  of  the  same  format 
as  output  cards  from  the  scanner  by  subroutine  PUNCH.   These  cards 
were  then  sorted  with  the  scanner  cards  such  that  all  the  A's, 
B's,  C s,  etc.,  were  together,  the  original  specimens  of  a  class 
preceding  the  scanner  specimens. 

The  next  step  was  a  card-to-tape  conversion  on  the  IBM 
l401;  the  program  generates  a  pair  of  card  images  on  tape  for 
each  specimen.   Images  are  in  mixed  mode;  the  column  binary 
portions  of  the  cards  are  written  in  binary  mode,  while  the 
hollerith  identification  is  written  in  BCD  mode. 

The  7090  was  then  used  by  the  GEN2KT  program  to  generate 
a  new  tape  from  the  tape  produced  above.   The  new  tape  was 
necessary  for  two  reasons:   First,  to  Improve  format  in  which 
data  were  placed  on  the  tape  to  render  quick,  random  access; 
second,  since  specimens  contain  speck  noise  the  removal  of  which 
is  a  lengthy  procedure,  the  DEN  routine  is  used  twice  to  denolse 
specimens. 

The  binary  tape  thus  contains  hO   logical  records  of  23OI 
words  each.   The  first  word  in  each  record  is  the  identification 
number,  1,2, 3,..., or  hO,    followed  by  50  words  containing  the 
specimen  identifications.   The  next  225O  words  contain  50  specimens. 
Symbols  are  on  tape  in  the  order  A,B, ,Z,  1,2,...,0,  (,),',*. 

5 •3.   Library  Input  Routine 

To  use  the  2000-specimen  library  tape,  a  special  input 
subroutine  NEWLIB ( NT, NS, SPEC, TAGS)   was  written.   In  this  routine, 
NT   is  the  number  of  the  library  tape,   NS   is  an  Integer  specifying 
the  symbol  desired   (1  =  A,   2  =  B,   ...,  hO  =    '),      SPEC  is  a 
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■block  of  2250  words  where  the  specimens  are  to  be  stored,  and 
TAGS  Is  a  block  of  50  words  where  the  specimen  names  are  to 
he  stored.   NS  can  of  course  he  an  Integer  variable  used  in  a 
D0  loop;  this  provides  a  very  convenient  way  of  sequentially 
obtaining  all  specimens.   Each  time  NEWLIB  is  called,  all  50 
specimens  of  the  desired  symbol  are  transferred;  no  provision  is 
made  for  partial  transfers  so  that  a  total  of  2^00  words  must  be 
provided. 

6.   RESOLUTION  OF  THE  STUDY  OF  PATTERN  RECOGNITION 
6.1.   General 

By  pattern  recognition  we  mean  a  process  of  classifica- 
tion --  more  precisely,  a  mapping  between  a  set  of  inputs  and 
a  set  of  outputs. 

A  natural  choice  using  digital  computer  technique  is  that 
the  outputs  be  unique  6-bit  binary  niombers,  entirely  arbitrary 
and  having  significance  only  by  prior  definition  or  convention. 
The  convention  adopted  in  our  study  was  the  IBM  BCD  (binary  coded 
decimal)  code,  one  of  the  most  compact  possible  ways  of  represent- 
ing outputs;  changing  a  single  bit  results  in  a  different  output 
class  or  an  illegal  one  (i.e.,  unintelligible  to  a  computer). 
There  was  a  total  of  ^1  output  classes:   26  letters,  10  numerals, 
h    special  characters,  and  1  reject. 

Inputs  consisted  of  1575-bit  binary  "codes"  representing 
40  classes  (same  as  output  with  omission  of  the  reject).   Binary 
representation  for  a  given  input  is  not  unique,  however,  and 
codes  representing  the  same  input  class  may  differ  in  several 
himdred  bit  positions.   The  recognition  problem  therefore  entailed 
assigning  (or  replacing)  the  highly  variable  input  codes  to  (by) 
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the  unique  output  codes.   It  should  he  noted  that  this  great 
variability  Is  a  direct  consequence  of  dealing  with  symhols 
foimd  by  hand.   Printing  done  by  machine  displays  little  varia- 
tion, and  that  Input  problem  Is  much  simpler. 

6.2.  Invariant  Properties 

Despite  the  highly  variable  nature  of  handprinted  speci- 
mens, there  must  be  something  Invariant  about  them  since,  after 
all,  a  human  being  Is  able  to  cope  quite  readily  with  extremes 
of  distortion.   The  problem  of  recognition  is  therefore  one  of 
finding  a  set  of  unique  Invariant  properties  for  each  input 
class.   Strictly  speaking,  there  Is  no  such  thing  as  an  absolute 
invariant  —  the  properties  are  statistically  distributed  over 
a  finite  range  rather  than  clustered  at  a  single  point.   In 
general,  the  more  closely  a  property  distribution  approaches 
the  Ideal  single  point,  the  more  useful  it  is  for  discrimination. 

It  is  possible  to  reduce  the  range  over  which  certain 
properties  are  distributed  by  imposing  constraints  on  the  speci- 
men source.   Constraints  may  vary  from  none  at  all  to  requiring 
that  each  symbol  be  of  fixed  form  and  dimensions,  i.e.,  fomied 
by  a  fixed  typeface.   While  it  is  true  that  increasingly  severe 
constraints  simplify  detection  and  utilization  of  properties, 
they  place  a  correspondingly  Increasing  burden  on  the  symbol 
source.   It  is  easy  to  devise  methods  for  recognition  of  printed 
material  but  rather  difficult  to  persuade  people  to  use  a  type- 
writer or  other  mechanical  aid  in  coding  their  programs. 

6.3.  Constraints  for  Input 

The  set  of  constraints  we  have  chosen  for  the  input 
represents  a  reasonable  compromise  between  burdening  the  symbol 
source  and  simplifying  property  detection  and  utilization: 
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(1)  The  character  set  (input  classes)  consisted  of  40 
handprinted  symbols:   The  26  letters  of  the  alphabet,  10  numerals, 
the  period,  comma,  and  left  and  right  parentheses. 

(2)  The  alphabet  symbols  were  restricted  to  upper-case 
block  print.   Since  certain  symbol  pairs  are  easily  confused, 
the  following  standard  FORTRAN  font  specifications  were  retained: 
(a)  Crossbar  in  letter  Z;  omitted  in  numeral  2.   (b)  Slash 
through  letter  0;  omitted  in  numeral  0.   (c)  Crossbars  on  letter 
I;  omitted  in  numeral  1. 

(5)   A  special  coding  form  was  used,  similar  to  the 
standard  FORTRAN  coding  sheet,  on  which  the  symbols  were  hand- 
printed, one  symbol  per  guide  box.   (The  coding  form  is  further 
described  above  at  Section  3-l'l«) 

6.4 .   Conversion  of  Specimens 

Handprinted  samples  of  letters  and  nijmerals  were  quantized 
into  1575-bit  binary  strings  by  projection  onto  a  rectangular 
grid  consisting  of  35  columns  and  45  rows.   This  was  accomplished 
photographically  in  the  first  part  of  the  study,  later  by  flying 
spot  scanner.   The  number  of  bits  was  chosen  to  preserve  small 
but  significant  details  in  the  specimens. 

The  first  representation  of  a  specimen  in  core  is  essen- 
tially a  finely-quantized  graphical  one  --  a  picture.   An  array 
of  bits  that  has  significance  only  in  the  spacial  interrelations 
of  individual  bits  is  difficult  to  operate  upon  directly;  there- 
fore, the  array  was  converted  into  a  table  of  integers.   The  table 
contains  information  obtained  (simulated)  by  scanning  each  row 
of  the  specimen  with  a  horizontal  sweep.   Included  for  each  row 
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are  Integers  representing  the  coordinate  of  the  left  edge,  the 
width  of  each  line  segment,  the  width  of  each  gap,  the  overall 
width  of  the  specimen,  and  the  number  of  segments  present. 

6.5.   Loop  Representation 

The  property  we  have  found  most  useful  for  character 
recognition  Is  the  presence  or  absence  of  loops.   Ordinarily  one 
thinks  of  a  loop  as  closed  but  this  concept  can  be  generalized  to 
Include  loops  open  on  one  or  more  sides.   In  our  approach  we  have 
restricted  ourselves  to  the  properties  of  one  or  more  closed 
loops,  loop  open  to  the  top  or  bottom,  and  no  loops.   Thus,  the 
letter  "A"  possesses  one  closed  loop  and  a  loop  open  to  the 
bottom;  "B"  has  two  closed  loops;  "K"  and  "X"  have  loops  open  to 
the  top  and  bottom;  "C"  has  no  loops  whatever  since  loops  open 
to  the  sides  were  not  considered  as  loops.   We  have  found  that  the 
loop  property  is  extraordinarily  resistant  to  distortion;  if  a 
symbol  has  been  sufficiently  deformed  to  alter  its  loop  category 
then  in  general  it  will  be  also  wrongly  classified  by  a  keypuncher. 
In  addition  to  this  valuable  ("property"),  the  loop  property  is 
relatively  easy  to  detect  and  process  by  either  digital  or  analog 
methods. 

Once  the  pictorial  data  have  been  converted  into  arithmetic 
form,  such  as  a  table  of  Integers,  it  is  relatively  easy  to  extract 
loop  Information.   Integers  representing  number  of  segments  are 
Identical  to  a  count  of  the  number  of  times  the  sweep  intersects 
the  letter.   Thus  for  "X",  Integers  away  from  the  middle  of  the 
letter  are  all  2's,  representing  two  intersections.   Clearly,  if 
a  loop  is  present,  it  must  be  reflected  by  presence  of  a  sequence 
of  2's  in  the  intersection  Integer  coliomn.   Examination  of 
extremities  of  the  sequence  determines  whether  the  loop  is  open- 
ended,  as  in  "X",  or  closed,  as  in  "A". 
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A  letter  like  "C"  normally  has  short  runs  of  2's  near 
top  and  bottom,  but  these  are  not  classified  as  loops  since  they 
are  inessential  to  the  letter's  configuration  --  the  letter  could 
readily  be  formed  with  straight  upper  and  lower  segments,  "[". 
However,  for  symbols  such  as  "U",  "V",  "X",  "K",  "A",  "8",  etc., 
this  is  clearly  not  the  case  --  the  2's  sequences  are  essential. 

Unfortunately,  not  all  40  characters  fall  into  a  simple 
loop-no-loop  category.   Letters  like  "M"  and  "¥",  "0"  and  certain 
others  have  complicated  intersection  sequences  that  may  include 
3's  and  4's.   These  letters  have  been  assigned  to  a  special  group 
which  requires  more  complex  processing. 

Many  symbols  fall  into  the  "no-loop"  category.   Clearly, 
once  this  classification  has  been  made,  further  discrimination 
is  not  possible  on  basis  of  loop  data.   At  this  point,  routines 
that  detect  line  endings,  cavities,  and  horizontal  discontinuities 
were  used  to  extend  the  subdivision. 

(:>.().      Property  Detection 

Fig.  6.1  represents  a  flow  chart  indicating  the  subroutines 
which  are  used  to  process  and  classify  an  input  specimen. 

In  trying  to  obtain  recognition  of  specimens  it  was  our 
philosophy  to  subdivide  the  class  into  smaller  and  smaller  classes 
using  reliable  routines  which  would  merely  describe  unique 
characteristics  of  the  specimens.   Such  characteristics  are  closed 
loops,  open  loops,  horizontal  lines,  etc.   Refining  these  character- 
istics of  a  specimen  subdivides  the  class  into  smaller  classes  of 
from  two  to  five  members.   Further  subdivision  then  would  be  more 
complicated  and  less  reliable,  since  differentiation  of  these 
members  by  human  perception  proved  difficult.   An  example  is  the 
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Fig.    6.1,      Recognition  Plow   Chart. 
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class  of  "S"  and  "5".   In  this  class  a  90%  differentiation  Is 
excellent,  since  many  5's  look  like  S's  and  a  few  S's  look  like 
5's.   The  dilemma  indicates  that,  to  further  approximate  machine 
recognition  to  that  of  human  capability,  context  must  he  examined 
and  used  as  part  of  the  recognition  process. 

6.7.   Details  of  Latest  Method 

In  our  latest  approach  the  mosaic  was  charted  into 
horizontal  information,  such  as  specimen  width,  number  of  inter- 
sections, left  edge,  right  edge,  segment  1,  gap  1,  segment  2, 
gap  2,  etc.   It  was  felt  that  this  horizontal  information  would 
be  less  sensitive  to  natural  tilt  of  handprinting  since  people 
tend  to  keep  horizontal  such  horizontal  lines.   The  routine 
which  does  the  charting  is  called  NUH0RE  which  operates  on  a 
specimen  read  from  tape  by  NEWLIB.   NEWLIB  is  a  routine  which 
reads  a  specimen  from  the  tape  library  of  2000  specimens.   The 
specimens  on  this  tape  are  those  obtained  from  the  scanner  and 
de-noised  twice  by  a  subroutine  DEN.   For  detailed  description 
of  these  or  other  subroutines  mentioned  in  this  section,  see  the 
appendix. 

The  next  routine  called  is  PREP.   This  routine  also  does 
accounting  and  removes  discontinuities;  it  works  on  the  chart 
prepared  by  NUH0RE.   PREP  computes  the  height  of  the  specimen, 
the  number  of  different  horizontal  intersection  sequences,  the 
number  of  rows  deleted,  the  kind  of  horizontal  intersection  and 
the  number  of  rows  in  the  particular  kind,  and  sets  a  switch  if 
the  specimen  is  blank  or  is  to  be  rejected.   It  normalizes  the 
data  in  the  chart  to  begin  at  the  top  row.   Discontinuities  which 
are  removed  are  those  where  a  row's  number  of  horizontal  inter- 
sections is  not  consistent  with  the  intersection  in  the  previous 
or  following  row.   In  such  case  PREP  removes  the  row  and  condenses 
the  chart . 

-  70  - 


After  the  PREP  routine  has  performed  its  function,  there 
is  still  a  discontinuity  which  has  to  be  removed,  one  where  the 
Intersections  from  row  to  row  Is  2  hut  the  gap  has  shifted  and  Is 
not  continuous.   The  KL0Z  routine  catches  this  discontinuity  and 
corrects  It  by  changing  the  rows  where  It  occurs  to  an  Intersection 
of  one.   See  Fig.  6.2.   KL0Z  works  on  about  1%  of  the  specimens, 
but  Its  Importance  lies  In  correcting  the  classification  at  a 
critical  point  In  the  subdivision  of  classes.   The  l/o  of  total 
specimens  Is  confined  to  a  small  class.  I.e.,  "N",  "B",  never 
"1",  "C".   If  KL0Z  operates  on  a  specimen  the  PREP  Information 
must  be  corrected  to  list  new  sequences.   It  Is  unnecessary 
entirely  to  rerun  the  PREP  routine;  therefore,  a  REPREP  routine 
was  written  to  perform  the  necessary  functions. 

The  next  routine  In  the  library  of  routines  Is  L00PS. 
This  subroutine  determines  whether  a  specimen  has  the  following 
characteristics:   Intersections  greater  than  two,  all  intersections 
equal  to  one,  closed  loops,  or  loops  open  to  the  top,  or  to  the 
bottom,  or  to  both.   A  letter  "A",  for  example,  has  a  closed  loop 
and  a  loop  open  to  the  bottom,  but  so  does  an  "R".   At  this  stage, 
then,  "A"  and  "R"  are  in  the  same  class. 

After  L00PS  is  employed  there  are  some  misclasslfications 
in  the  letters  with  loops.   These  errors  are  where  loops  were 
left  open.   See  Fig.  6.3. 

HKL0Z  is  a  routine  designed  to  close  loops  which  are  left 
open.   It  examines  the  gaps  of  the  two  Intersection  parts  of  the 
specimen.   If  the  gap  decreases  and  then  Increases  by  a  predeter- 
mined amount,  the  gap  is  closed  at  the  narrowest  point.   In  this 
way  some  specimens  are  corrected  so  that  they  fall  into  the 
correct  class.   About  3%  of  all  specimens  are  corrected  by  HKL0Z. 
If  HKL0Z  operates  on  a  specimen,  REPREP  then  has  to  be  used  to 
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correct  sequences.   Also,  in  the  main  program  If  HKL0Z  changed  the 
specimen  L00PS  Is  called  again  to  operate  on  it. 

After  the  ahove-mentioned  routines  are  used,  classes 
that  exist  are  as  follows: 


Class 

1  Two  closed  loops 

2  One  closed  loop,  one 
loop  open  to  the 
bottom 

3  One  closed  loop 

4  One  loop  open  to  the 
top 

5  One  loop  open  to  the 
top  and  one  open  to 
the  bottom 

6  No  loops,  open  or      C,  E,  F,  I,  J,  L,  S,  T,  Z,  1, 
closed  2,  3,  5,  7,    (,), 

7  Letters  with  no  loops  M,  N,  0,  Q,  W,  G 


Members 

B,    8 

A,    R 

D,    P, 

0, 

4, 

6, 

9 

U,    V, 

Y, 

h 

H,    K, 

X, 

N 

> 


but  have  three  or 
more  parallel  lines 

8   Rejects 

Three  or  more  closed 
loops,  one  loop  open 
to  bottom,  one  closed 
loop  and  one  loop  open 
to  the  top 

Results  for  loop  letters  are  in  Table  6.1. 

The  largest  of  these  classes  is  the  "no-loop"  class. 
However,  this  class  can  be  subdivided  by  routine  PEAKS,  which 
detects  and  describes  horizontal  discontinuities  in  the  width  of 
the  letter.   The  subroutine  PEAKS  operates  on  all  letters  which 
have  no  closed  nor  open  loops.   It  determines  the  number,  location 
and  direction  of  horizontal  segments.   This  subroutine  in  its 
original  form  yielded  good  results;  however,  it  was  weak  with 
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respect  to  the  location  and  direction  of  horizontal  lines,  and 
It  also  missed  steeply-sloped  lines.   These  weaknesses  were 
corrected  hy  modifying  PEAKS  and  adding  corrective  subroutines 
SL0PE  and  FIXNT.   The  modification  In  PEAKS  corrected  the  location 
of  horizontal  line  segments  hy  using  a  variable  proportional  to 
the  height  of  a  specimen  for  locating  top,  middle,  or  bottom 
horizontal  lines.   The  subroutine  SL0PE  checks  specimens  with 
no  horizontal  entries  In  the  top  or  bottom  for  slopes  of  45°  or 
greater.   The  subroutine  FIXNT  corrects  the  direction  of  the  top 
horizontal  entry.   These  corrections  Increased  recognition  to 
greater  than  95%  for  the  subgrouplngs.   See  Table  6.2. 

The  next  phase  of  our  study  Involved  further  breaking 
up  of  the  subgrouplngs.   A  routine  was  developed  to  separate  "H" 
from  "K"  and  "X";  It  examined  the  left  and  right  sides  of  the 
specimen  and  detected  cavities.   "H"  has  no  cavities  on  either 
side;  "K"  has  one  cavity  on  the  right  side;  "X"  has  one  cavity 
on  both  sides.   This  was  an  excellent  technique  for  the  subclass: 

Right  Side  Left  Side 

H       50  no  cavities  50  no  cavities 

K       49  cavity  right,  1  no  cavity   50  no  cavities 
X       47  cavity  right,  3  no  cavity   5  no  cavities,  45  cavity 

The  cavity  scheme  examines  a  side  for  In-then-out  sequences  of 
a  predetermined  difference.   It  also  worked  very  well  for  the 
A-R  class: 

Right  Side 

A  48  no  cavities,  2  cavity 

R  50  cavities 

Other  subgrouplngs  would  be  more  difficult  to  subdivide  and  would 
have  to  employ  curvature  detection  for  separation;  examples  are 
"S"  from  "5",  left  parenthesis  from  "C",  "B"  from  "8",  etc. 
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7.   CONCLUSIONS  AND  SUMMARY 

The  philosophy  guiding  our  efforts  In  character  recognition 
has  been  that,  as  the  state  of  the  computing  art  advances,  cost 
per  quantum  of  computation  will  become  so  small  that  It  will  he 
feasible  to  use  software  techniques  to  perform  even  very  complex 
operations  like  visual  pattern  recognition.   To  this  end  we  have 
tried  to  develop  methods  that  would  be  suitable  for  a  very  fast 
general  purpose  machine.   Our  approach  has  been  diametrically 
opposite  from  that  of  Industry,  which  has  tended  to  center 
around  special  purpose  analog  equipment.   The  analog  approach 
has  certain  advantages;  It  does  not  require  advances  In  the  present 
state  of  the  digital  art.  It  Is  less  costly,  and  It  results  In 
self-contained  equipment  which  can  be  used  on  sites  not  having 
computing  facilities.   The  chief  drawback  Is  that  performance 
is  poor  except  on  rigorously  constrained  fonts.   As  of  mid- 
1964,  there  is  no  satisfactory  analog  equipment  capable  of 
discriminating  handprinted  letters  and  numerals.   Our  feeling  is 
that  really  high  levels  of  performance  will  require  a  great  deal 
of  data  processing,  and  that  this  will  be  performed  best,  as  well 
as  most  economically,  by  a  general  purpose  digital  machine.  To 
achieve  99 /o  recognition  accuracy  or  better  will  probably  require 
the  use  of  context  information,  and,  at  least  for  FORTRAN,  this 
could  be  done  most  expeditiously  by  combining  compiler  software 
with  the  recognition  program. 

Our  approach  to  the  pattern  recognition  problem  has  not 
been  entirely  successful  since  we  have  not  been  able  to  obtain 
complete  discrimination  into  classes  containing  one  and  only  one 
symbol.   The  routines  we  have  developed  provide  a  powerful  and 
reliable  subdivision  into  approximately  twenty  classes;  beyond  this 
point  performance  deteriorates.   The  properties  characterizing 
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these  residual  classes  are  statistically  distributed  In  a  fairly 
broad  way,  with  considerable  overlap  between  members.   For  example, 
one  of  the  most  troublesome  residual  classes  has  only  two  members, 
"S"  and  "5".   The  only  way  this  pair  can  be  separated  Is  by  con- 
sideration of  the  curvature  of  the  upper  half.   Unfortunately, 
there  Is  no  sharp  point  of  demarcation  In  this  property.   No 
matter  where  one  sets  a  curvature  threshold,  there  will  be  appre- 
ciable (15/0-20/0)  mlsclasslflcatlon.   Our  method  can  reliably 
tell  us  if  a  specimen  is  an  "S"  or  a  "5",  but  beyond  this  point 
Its  reliability  is  inadequate.   What  seems  to  be  necessary  is  a 
set  of  tests;  however,  it  is  very  difficult  to  devise  such  a  set 
since  usually  only  one  or  a  few  of  the  discriminatory  properties 
(such  as  curvature)  are  available  to  us  on  a  conscious  level  via 
introspection.   An  automatic  method  for  devising  and  evaluating 
the  utility  of  various  tests  is  greatly  needed.   Another  technique 
which  merits  further  investigation  is  variable  weighting  of  the 
various  properties  as  measured  in  a  given  specimen.   Frequently 
in  attempting  recognition  of  badly  distorted  symbols  one  finds 
a  single  fragment  or  remnant  of  a  property,  and  the  decision 
seems  to  be  based  entirely  on  this  single  entity  —  the  other 
portions  of  the  field  are  discarded.   The  crucial  property  is  not 
constant,  varying  even  in  samples  of  a  single  symbol.   Probably 
the  best  overall  results  would  be  obtained  by  combining  one  of 
these  schemes  with  a  reliable  property  detector  like  L00PS  or 
PEAKS . 

APPENDIX.   SUBROUTINES  FOR  THE  FINAL  FORM  OF  THE  PAGE  READER 

A.l.   Noise  Elimination  (DEN) 

The  output  of  the  flying  spot  scanner  contains  a  certain 
amount  of  "speck"  noise,  isolated  bits  scattered  here  and  there 
in  the  specimen  field  much  like  plums  in  a  pudding.  .  This  noise 
is  due  to  minute  imperfections  in  the  surface  of  the  paper  on 
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which  the  specimens  are  printed,  and  cannot  be  eliminated  by  any- 
practical  method.   However,  once  the  specimens  have  been  quantized. 
It  Is  relatively  easy  to  write  a  subroutine  that  will  eliminate 
Isolated  specks  and  even  small  blotches  and  streaks. 

The  specimen  Is  divided  Into  1575  elements,  each  4x4 
thousandths  of  an  Inch,  and  Is  represented  digitally  as  a  "one" 
or  a  "zero"  depending  upon  whether  or  not  each  element  contains 
greater  or  less  than  50/b  black.   A  typical  specimen  contains 
lines  four  or  five  elements  wide  but  may  be  as  thin  as  two  ele- 
ments wide.   Therefore,  a  line  or  black  area  of  one  element  in 
width  is  noise.   However,  border  elements  may  be  one  element  in 
width  since  a  line  can  overlap  the  border;  these  border  elements 
must  not  be  considered  noise.   Cavities,  on  the  other  hand,  since 
they  are  an  absence  of  black,  may  be  created  by  two  lines  one 
element  apart,  and  the  one  element  separating  the  two  lines  should 
not  be  considered  to  be  noise.   This  leaves  as  noise  cavities 
of  one  or  two  elements  in  the  total  cavity  area.   With  this 
approach  to  noise  elimination,  subroutine  "DEN"  was  written  to 
eliminate  noise  as  illustrated  in  Figs.  A.l  and  A. 2. 

"DEN"  functions  as  follows:  (1)  It  examines  the  "ones" 
first  and  changes  them  to  "zeros"  if  the  north,  south,  east,  and 
west  elements  in  the  original  specimen  are  as  follows: 


0 

• 

0 

0 

0 

• 

0 

0    •    0 

0    •    0 

0    •     • 

0    •    0 

•     •    0 

0    *    0 

•         •         • 

0 

0 

0 

• 

0 

• 

0 

(2)  It  then  examines  the  "zeros"  of  the  specimen  with  the 
'ones"  changed.   The  following  "zeros"  are  changed  to  "ones": 


0 


0 


0  0 


0 
0 


0  0 


In  the  examples  the  center  element  is  the  one  examined. 
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Fig.  A.l.   Types  of  Noise  Eliminated  ("zero":  0,    "one":  •) 
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Fig.    A. 2. 
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(3)  Border  rows  or  coliimns  are  treated  as  follows:   A 
row  of  "zeros"  is  added  around  the  border,  and  the  "ones"  and 
"zeros"  are  treated  as  in  (1)  and  (2)  except  that  In  (1)  the 
last  two  examples  are  not  noise  for  border  elements. 

This  worked  very  well  on  the  400  samples;  DEN  may  be 
done  several  times  without  damaging  the  specimen.   A  set  of  40 
specimens  was  run  off  on  the  flying  spot  scanner  with  the  level 
of  detection  varied  between  a  "one"  and  a  "zero",  and  the  speci- 
mens were  denoised  (DEN)  four  times.   It  was  noted  that  those 
specimens  with  a  high  level  of  detection,  which  means  an  excess 
of  "zero"  or  cavity  noise,  were  not  denoised  very  well.   This  is 
inherent  in  the  subroutine  since  it  first  denoises  "ones".   A 
"DEN"  which  denoised  "zeros"  first  would  have  yielded  opposite 
results. 
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A. 2.   NEWLIB  (IT, J, SPEC, TAGS) 


Calling  NEWLIB  results  in  a  transfer  of  50  specimens 
and  their  names  into  memory. 


J  -   class  desired  (l  for  A,  2  for  B, 
SPEC  =  2250  word  block  for  specimens 
TAGS  =  50  word  "block  for  specimen  names 
IT  =  tape  number 
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Forty  records,  each  with  23OI  words. 

First  word  is  the  record  number,  ranging  from  1  to  kO, 
used  for  identification. 

Next  50  words  are  names,  in  order  Al,  A2,  ...,  A50. 

Next  2250  words  are  5O  specimens,  45  words  each.   Each 
has  been  denoised  twice.   In  reading  the  tape,  a  speci- 
men is  read  from  bottom  to  top. 


Fig_.  A. 4.   2K  Library  Tape  for  Denoised  Specimens. 
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A. 3.   NUH0RE 

Horizontal  intersection  data  for  specimen. 

A.i|.   Preprocessor  (PREP) 

The  preprocessor  (PREP)  takes  the  horizontal  Information 
and  removes  discontinuities  In  the  number  of  Intersections  from 
row  to  row;  I.e.,  each  row  must  have  a  row  directly  above  or 
directly  below  It  with  the  same  number  of  horizontal  Intersections 
or  else  the  row  Is  deleted.   Exceptions  to  this  are  rows  1  or  45. 
In  these  rows.  If  the  number  of  horizontal  Intersections  Is  1, 
the  row  is  retained  independently  of  adjacent  rows  to  preserve 
closed  loops  where  the  closing  of  the  loop  was  made  at  the  top 
or  bottom  border  of  the  specimen.   The  preprocessor  (PREP)  also, 
after  removing  odd  rows,  normalizes  the  data  to  top  (R0W  1)  and 
calculates  the  following: 

NSEQ  (number  of  different  horizontal  intersection  sequences) 

NHITE  (height  of  the  specimen); 

N0UT  (number  of  rows  deleted); 

NT0T  0,  NT0T  1,  NT0T  2,  NT0T  3,  NT0T  4  (total  number  of 
0,  1,  2,  3,  and  4  horizontal  Intersections  within  the  specimen); 

NKIND  (I)  and  NUMBER  (I)  from  1=1,  NSEQ  (the  kind  of 
horizontal  intersection  and  number  of  rows  in  the  particular 
kind);  and 

K  (K=0  (specimen  OK),  K-1  (specimen  blank),  K=2 
(NSEQ  >  10),  K=3  (NHITE  <  5),  K=:4  (N0UT  >  6)). 

PREP  also  retains  INT=1,  where  INFO  is  larger  than  sum 
of  SEGl  and  SEG2  of  both  row  above  and  below  INT=1. 
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A. 5.   KL0Z 

Subroutine  to  check  INT=2  sequences. 
A. 6.   REPREP 

Subroutine  to  recompute  NSEQ. 

A. 7.   L00PS 

The  subroutine  L00PS  determines  whether  or  not  a  specimen 
has  the  following  characteristics: 

1.  Intersections  greater  than  two; 

2.  All  Intersections  less  than  two; 

3.  Closed  loops; 

h.      Open  loop  to  the  top,  or  bottom,  or  both. 

It  determines  the  above  with  the  following  variables: 
NL00P,  a  dimensioned  array  coded  from  the  top  to  the  bottom  of 
a  specimen,  as  to  the  type  of  Intersection  transition  and  as  to 
the  number  of  INT  =  1,  or  INT  =  2.   That  Is,  0  equals  a  grouping 
of  five  INT=1  or  a  grouping  of  five  INT=2.   1  equals  closed  loop 
to  the  bottom,  2  equals  open  loop  to  the  bottom,  5  equals  closed 
loop  to  the  top,  4  equals  open  loop  to  top;  as  can  be  seen,  1  and 
2  describe  an  Intersection  transition  from  INT  =  1  to  INT  =  2, 
and  3  describes  an  Intersection  transition  from  INT  =  2  to  INT  =  1, 
A  typical  example  of  an  NL00P  array  for  specimen  A  Is  010030104. 
NL  Is  the  number  of  digits  in  the  NL00P  array  so  that,  for  the 
given  example,  NL  =  9.   LPS  Is  the  number  of  closed  loops,  and 
KPS  Is  a  coded  variable  for  open  loops  toward  the  top,  or  bottom, 
or  both  (I.e.,  KPS  =  0  means  no  open  loops  toward  the  top  or 
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"bottom,  KPS  =  1  means  an  open  loop  toward  the  top,  KPS  =  2  means 
an  open  loop  toward  the  bottom,  and  KPS  =  3  means  an  open  loop 
toward  both  top  and  bottom). 

Variables  are  calculated  in  the  following  fashion:   First, 
the  niamber  of  sequences  is  examined;  if  it  is  1  and  the  first  row 
has  INT  =  1,  this  specimen  cannot  have  any  loops.   Therefore, 
LPS  and  KPS  are  set  equal  to  0,  NL00P' (1)  =  0,  NL  =  1,  and  the 
specimen  is  returned  to  the  main  program.   Next,  if  the  specimen 
remains  in  the  subroutine,  the  intersection  column  is  examined 
to  determine  if  INT  >  2.   If  it  is,  LPS  =  9  and  the  specimen  is 
sent  back  to  the  main  program.   After  these  first  two  tests  are 
completed  if  the  specimen  still  remains  in  the  subroutine,  the 
following  tests  are  performed  to  calculate  the  above  variables: 

The  NL00P  one-dimensioned  array  is  calculated  by  examining 
the  INT  column  from  top  to  bottom.   If  the  number  of  intersections 
in  the  INT  column  does  not  change  for  five  rows,  a  0  is  added  to 
the  NL00P  array.   If  the  number  of  intersections  does  change  from 
one  row  to  the  next,  the  type  of  transition  is  noted  (i.e.,  from 
INT  =  1  to  INT  =  2,  or  from  INT  =  2  to  INT  =1).   Next,  the  kind 
of  transition  must  be  determined  (i.e.,  opened  or  closed);  it  is 
determined  by  the  following  equations: 

See  Fig.  A. 11. 

X  =  NLEFT  (INT  =  2)  +  JSEGl  (INT  =  2)  -  NLEFT 

(INT  =  1) 
Y  =  X  +  JGAPl  (INT  =  2)  -  JSEGl  (INT  =  1) 
For  a  closed  loop,  X  >;  0  and  Y  j<  0 

If  there  is  a  closed  loop  and  the  type  of  transition 
was  from  INT  =  1  to  INT  =  2,  then  NL00P(I)  =1.   If  it  was  the 
same  type  of  transition  but  an  open  loop,  NL00P(I)  =  2.   If  it 
was  the  opposite  type  of  transition,  2  is  added  to  the  NL00P(I). 
NL  is  equal  to  the  number  of  digits  in  the  NL00P  array. 
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LPS  and  KPS  are  calculated  by  analyzing  the  NL00P  array. 
LPS  is  equal  to  the  number  of  times  1  is  followed  by  3^  zeros 
not  counted,  in  the  NL00P  array.   If  LPS  =  2,  then  KPS  =  0  and  the 
specimen  is  returned  to  the  main  program.   If  LPS  is  less  than  2, 
then  the  KPS  test  is  performed. 

KPS  is  coded  in  the  following  fashion.   If  the  NL00P 
array  starts  with  2  followed  by  0,  or  0  followed  by  2  followed 
by  0,  then  KPS  is  set  equal  to  1  (open  loop  toward  the  top).  Also, 
if  zero  is  followed  by  any  niimber  of  zeros  and  3,  KPS  is  set  equal 
to  1.   If,  in  starting  from  the  bottom  of  the  NL00P  array  a  4  is 
followed  by  0,  or  0  is  followed  by  4  followed  by  0,  then  KPS  is 
set  equal  to  2  (open  loop  toward  the  bottom).   Also,  if  zero  is 
followed  by  any  number  of  zeros  and  1,  KPS  is  set  equal  to  2. 
The  open  loop  toward  the  top  is  determined  first.   If  there  is  an 
open  loop  toward  the  top,  then  an  open  loop  toward  the  bottom  need 
not  have  0  before  the  1  or  0  after  the  4.   The  same  is  true  of  the 
top;  if  at  first  it  does  not  have  an  open  loop  toward  the  top  and 
there  is  an  open  loop  toward  the  bottom,  then  the  top  of  the  NL00P 
array  is  reexamined  for  3  not  preceded  by  0,  or  2  not  followed 
by  0.   If  there  are  loops  open  both  toward  the  top  and  bottom, 
KPS  =  3. 
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A. 8.   HKL0Z 

Subroutine  to  close  horizontal  gaps. 

A. 9.   PEAKS 1 

The  subroutine  PEAKS  operates  on  all  those  specimens 
which  have  both  LPS  and  KPS  =  0.   It  determines  the  number, 
location,  and  direction  of  horizontal  segments  by  calculating  the 
following  variables:   MINMAX,  a  one-dlmensloned  array  which  con- 
tains numbers  coded  for  a  change  In  width  (I.e.,  0  equals  no 
change  In  width  (NHITE+4)/9  but  not  less  than  3  for  five  consecu- 
tive rows  of  INT  =  1,  1  equals  a  decrease  to  the  right  In  width 
of  five  elements  from  row  N  to  row  N+2,  2  equals  a  decrease  to  the 
left,  3  equals  a  decrease  to  both  left  and  right,  h   equals  an 
increase  to  the  left,  5  equals  an  Increase  to  the  right,  6  equals 
an  Increase  to  both  left  and  right).   J  Is  equal  to  the  number  of 
digits  In  the  MINMAX  array.   NPKS  Is  equal  to  the  number  of  hori- 
zontal segments.   NT,  NM,  and  NB  are  coded  variables  for  horizontal 
segments  at  the  top,  middle,  and  bottom  of  the  specimen  (i.e.,  0 
equals  no  segment,  1  equals  segment  to  the  left,  2  equals  segment 
to  the  right,  and  3  equals  segment  to  both  left  and  right). 

The  variables  are  calculated  in  the  following  fashion: 
First  the  MINMAX  array  and  J  are  calculated.   Then  NPKS, NT, NM, 
and  NB  are  determined  from  the  MINMAX  array.   The  MINMAX  array 
is  computed  as  follows:   The  width  column  is  examined  from  top 
to  bottom  by  subtracting  the  width  of  row  N+2  from  the  width  of 
row  N.   If  there  is  a  change  of  less  than  five  elements,  N  is 
increased  by  1  and  the  computation  is  repeated.   If  five  suc- 
cessive rows  do  not  yield  a  change  of  five  elements  and  INT  =  1, 
a  0  is  added  to  MINMAX  array.   If  there  is  a  change  of  plus  five 
or  greater,  this  means  that  the  width  of  row  N  is  greater  than  the 


width  of  row  N+2,  and  the  niimloers  4,  5,  or  6  must  he  selected. 
Left  edges  of  row  N  and  N+2  and  right  edges  of  row  N  and  N+2  are 
subtracted.   If  both  of  these  differences  are  equal  to  or  greater 
than  3,  then  the  number  6  is  selected.   If  the  subtraction  of 
just  the  left  edges  yielded  3  or  greater,  then  the  nianber  4  is 
selected;  if  the  subtraction  of  just  the  right  edges  yielded  3 
or  greater,  then  the  number  5  is  selected.   Similarly,  If  there 
is  a  change  of  -5  or  greater,  the  numbers  1,  2,  or  3  must  be  se- 
lected and  are  selected  as  follows:   3  is  selected  if  both  left 
and  right  edges  have  a  change  of  3  or  greater;  2  is  selected  if 
just  the  right  edge  has  a  change  of  3  or  greater;  1  is  selected 
if  just  the  left  edge  has  this  change. 

In  computation  of  the  MINMAX  array  the  following  rules 
are  also  used:   The  MINMAX  array  cannot  start  with  a  number 
greater  than  3  nor  can  it  end  with  a  number  less  than  h   because 
it  is  implied  that  there  will  be  an  increase  in  width  at  the  top 
and  a  decrease  in  width  at  the  bottom  of  a  specimen.   Also, 
consecutive  numbers  less  than  4,  or  greater  than  3j  must  be  re- 
solved to  one  number.   If  all  of  the  consecutive  numbers  are  equal, 
this  one  number  is  equal  to  one  of  them.   If  they  are  different, 
3  or  6  will  be  substituted  for  them.   If  within  the  array  there 
is  an  increase  followed  by  a  decrease,  then  they  are  made  compati- 
ble (i.e.,  4l,  52,  and  63  are  compatible;  in  all  other  cases  the 
increase  is  made  6). 

NPKS  is  calculated  by  examining  the  MINMAX  array  as  fol- 
lows:  The  first  decrease  in  width  will  make  NPKS  equal  to  1. 
Then  only  the  increases  in  width  are  counted  and  added  to  NPKS. 
If  NPKS  =  0,  then  NT,  NM,  and  NB  are  made  equal  to  zero,  and  the 
specimen  is  returned  to  the  main  program.   If  NPKS  7^  0,  then  NT, 
NM,  and  NB  are  calculated  in  the  following  fashion:   NT  =  MINMAX(l), 
If  MINMAX(l)  =  0,  then  NT  =  MINMAX(2)  or  NT  -  MINMAX(2)  -  3  if 
MINMAX(2)  >  3-   If  MINMAX(l)  =  MINMAX(2)  =  0,  then  NT  =  MINMAX(3) 
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only  if  it  is  less  than  4,  otherwise  NT  =  0.   Next,  NB  is  calculated 
--  only  if  NT  did  not  determine  NPKS  —  by  examining  the  bottom 
of  the  MINMAX  array.   NB  =  MINMAX(J)  -  3-   If  MINMAX(J)  =  0, 
then  NB  =  MINMAX(J-l)  or  NB  =  MINMAX(J-l)  -  3  if  MINMAX(J-l)  >  3- 
NM  is  calculated  --  only  if  NT  and  NB  failed  to  determine  all  of 
the  NPKS  --by  examining  the  remainder  of  the  MINMAX  array  for  a 
MINMAX(N)  >  3.   NM  =  MINMAX(N)  -  3.   When  the  above  computations 
have  been  completed,  the  specimen  is  returned  to  the  main  program. 

A. 10.   SL0PE 

Subroutine  SL0PE  catches  letters  which  have  been  classified 
by  PEAKS  as  having  no  peaks  at  the  top  and/or  bottom,  but  which 
have  a  45   slope  to  the  right  or  left.   It  does  this  as  follows: 
First  it  examines  NT  and  NB  to  see  if  they  are  zero.   If  NT  =  0, 
the  middle  of  Row  2  is  compared  with  the  middle  of  Row  (NHITE/3). 
If  the  difference  between  these  two  middles  is  greater  than  or 
equal  to  (NHITE/3  -  1),  4  or  5  is  selected  for  NT:   4  if  the 
middle  of  Row  2  is  to  the  right  of  the  middle  of  Row  (NHITE/3),  or 
5  if  it  is  to  the  left.   The  same  holds  for  NB;  if  NB  =  0,  the 
middle  of  Row  (NHITE-1)  is  compared  with  the  middle  of  Row  (NHITE  - 
NHITE/3),  and  4  or  5  is  selected  as  above.   See  Fig.  A.I5. 
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A. 11.   FIXNT 

Subroutine  FIXNT  computes  the  overhang  ahove  the  minimum 
segment  in  the  top  half  of  a  letter  and  uses  it  to  correct  most 
mlsclassificatlons  of  NT.   It  accomplishes  this  as  follows: 

First,  if  NM  ^   0,  it  is  made  equal  to  1  because  NM  should 
he  an  indicator  as  to  whether  or  not  there  was  a  discontinuity  in 
width  in  the  middle  of  the  letter;  left,  right,  or  both  is  not 
applicable  to  this  middle  discontinuity.   Next,  if  0  <  NT  <  4, 
the  overhang  to  the  left  and  right  of  the  focal  segment  is  deter- 
mined by  traveling  up  from  the  focal  segment  toward  the  top, 
noting  the  cumulative  amount  of  overhang  to  the  left  and  right  of 
this  segment. 

The  focal  segment  is  determined  by  examining  the  JGAP5 
column  from  top  to  bottom  for  the  last  decrease  in  width  within 
the  top  half  of  the  letter,  without  two  or  more  no  changes 
between  it  and  the  preceding  decrease  (recalling  that  the  JGAP5 
column  has  all  of  the  MINMAX  coding).   If  the  MINMAX  coding  of 
this  row  indicates  a  decrease  to  both  left  and  right,  the  de- 
creased row  is  selected  as  the  focal  row  and  the  width  of  this 
row  as  the  focal  segment.   If  the  MINMAX  coding  indicates  a 
decrease  to  either  left  or  right,  the  intersection  of  the  row 
above  the  decrease  is  examined.   If  it  is  1,  the  decreased  row 
is  selected  as  above.   If  it  is  2,  the  opening  is  followed  up 
toward  the  top  until  closure,  or  to  Row  3,  whichever  comes  first. 
The  row  two  rows  below  this  row  is  selected  as  the  focal  row,  and 
the  right  segment  of  this  row  is  chosen  as  the  focal  segment  if 
MINMAX  indicated  the  decrease  was  toward  the  right,  or  the  left 
segment  if  toward  the  left. 
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Most  of  the  misclasslfied  letters  were  those  where 
NM  7^  0  and  NT  =  3,  so  that,  if  NM  ^  0  and  NT  =  3,  NT  was  changed 
to  1  or  2  depending  upon  which  overhang  was  greater,  the  left 
or  right. 
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